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(54) IMAGE PROCESSOR AND OBJECT TRANSFER DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To recognize a three- 
dimensional position of an object in a short time by an 
image memory of a small capacity and simple device 
constitution by generating a distance image of loaded a 
plurality of objects and extracting a top stage surface 
area from the distance image. 
SOLUTION: The image of a recognition object is 
inputted to a distance image generation means 12 by an 
image input means 1 1 and the distance image is 
generated. Then, by a top stage surface area extraction 
means 13, the top stage surface area provided with a 
height equivalent to the object of a top stage is 
extracted. Since the object of the top stage surface 
area expressed by binary values looks like a rectangular 
pattern on the image, by detecting side edge parts 
crossed at the right angle, a candidate is extracted. An 
object candidate is positioned by using a template 
matching method by an object position detection means 
17. By coarsely generating the distance image, 

extracting the candidate of the object from there and executing detailed position detection in 
the form of extremely limiting the range of pattern retrieval, the distance image generator is 
made small in the device scale. 
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* NOTICES * 



JP0 and INPIT are not responsible for any 
damages caused by the use of this translation. 



1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1]A depth map creating means which generates a depth map of two or more loaded 
objects, and a highest rung surface area extraction means to extract highest rung surface area 
of an object located in the highest rung from a depth map, A highest rung object candidate 
extraction means to dissociate separately and to extract an object from highest rung surface 
area, An object size database which stores size data of recognition objects, and a two- 
dimensional reference pattern creating means which generates a standard pattern image on an 
objective two-dimensional picture based on objective size data, A shade original image storing 
means which stores a shade original image inputted from a camera, An object position detecting 
means which detects an objective position using information on the above-mentioned two- 
dimensional reference pattern and the above-mentioned shade original image about a highest 
rung object candidate extracted according to the above-mentioned individual, An image 
processing device which is provided with an information integration means which unifies a 
detection result of an object position obtained by each above-mentioned means, and distance 
information of each object obtained by a depth map creating means, and outputs three 
dimensional position information on each object body. 

[Claim 2]A depth map creating means which generates a depth map of two or more loaded 
objects, and a highest rung surface area extraction means to extract highest rung surface area 
of an object located in the highest rung from a depth map, A highest rung object candidate 
extraction means to dissociate separately and to extract an object from highest rung surface 
area, An object size database which stores size data of recognition objects, and a two- 
dimensional reference pattern creating means which generates a standard pattern image on an 
objective two-dimensional picture based on objective size data, A shade original image storing 
means which stores a shade original image inputted from a camera, An object position detecting 
means which detects an objective position using information on a two-dimensional reference 
pattern and a shade original image about a highest rung object candidate extracted according to 
the above-mentioned individual, It has an information integration means which unifies a detection 
result of the above-mentioned object, and distance information of each object obtained by a 
depth map creating means, An object transfer equipment which is provided with an object 
transfer means which grasps and transfers an image processing device and an object which 
output three dimensional position information on each object body, and transfers an object based 
on an output signal of a described image processing unit. 

[Claim 3]A random texture light projection means which floodlights a texture pattern random in a 
depth map creating means, The image processing device according to claim 1 comprising a with 
means corresponding to a stereo image block to carry out with correspondence between two 
pictures which the first image input means and the second image input means which input a 
stereo image, and the above-mentioned first and the second image input means picturized. 
[Claim 4]A random texture light projection means in which a depth map creating means 
floodlights a random texture pattern, The first image input means and second image input means 
that input a stereo image, The object transfer equipment according to claim 2 which is provided 
with an object transfer means which grasps and transfers an image processing device and an 
object which comprised a with means corresponding to a stereo image block to carry out with 
correspondence between two pictures which the above-mentioned first and the second image 
input means picturized, and transfers an object based on an output signal of a described image 
processing unit. 

[Claim 5]A low resolution depth map creating means in which a depth map creating means 
generates a depth map with coarse resolution, A level difference region extraction means to 
extract an objective level difference region part from a low resolution depth map, The image 
processing device according to claim 1 comprising a high resolution depth map creating means 
which generates a depth map of high resolution to a level difference region, and a depth map 
synthesizing means which compounds two depth maps from which resolution of the above- 
mentioned low resolution depth map and a high resolution depth map differs. 
[Claim 6]A low resolution depth map creating means in which a depth map creating means 



generates a depth map with^Brse resolution, A level difference re extraction means to 
extract an objective level difference region part from a low resolutior^lepth map, A high 
resolution depth map creating means which generates a depth map of high resolution to a level 
difference region, The object transfer equipment according to claim 2 which is provided with an 
object transfer means which grasps and transfers an image processing device and an object 
which comprised a depth map synthesizing means which compounds two depth maps from which 
resolution of the above-mentioned low resolution depth map and a high resolution depth map 
differs, and transfers an object based on an output signal of a described image processing unit 
[Claim 7]A high-speed similarity calculation means by which a with means corresponding to a 
block searches for a correspondence image block on either side at high speed, The image 
processing device according to claim 2 which comprised a high reliability similarity calculation 
means to calculate similarity to high reliability about a pair of a block which is search results, and 
a corresponding block reliability judgment means will judge that have no corresponding block if 
the above-mentioned high reliability similarity is below a fixed threshold. 
[Claim 8]A high-speed similarity calculation means by which a with means corresponding to a 
block searches for a correspondence image block on either side at high speed, A high reliability 
similarity calculation means to calculate similarity to high reliability about a pair of a block which 
is search results, The object transfer equipment according to claim 4 which will be provided with 
an object transfer means which grasps and transfers an image processing device and an object 
which comprised a corresponding block reliability judgment means judge that has no 
corresponding block if the above-mentioned high reliability similarity is below a fixed threshold, 
and transfers an object based on an output signal of a described image processing unit 
[Claim 9]Have three or more image input means, and a with means corresponding to a block 
chooses two or more kinds of picture pairs which chose an inner 2 ** picture of each picture 
acquired from the three or more above-mentioned image input means, The image processing 
device according to claim 1 or 3 performing with [ corresponding to a block ], unifying each 
search results with correspondence, and generating a depth map. 

[Claim 10]Have three or more image input means, and a with means corresponding to a block 
chooses two or more kinds of picture pairs which chose an inner 2 ** picture of each picture 
acquired from the three or more above-mentioned image input means, The object transfer 
equipment according to claim 2 or 4 which performs with [ corresponding to a block ], is provided 
with an object transfer means which grasps and transfers an image processing device and an 
object which unify each search results with correspondence and generate a depth map, and 
transfers an object based on an output signal of a described image processing unit 
[Claim 11]A depth map creating means which generates a depth map of two or more loaded 
objects, and a highest rung surface area extraction means to extract highest rung surface area 
of an object located in the highest rung from a depth map, An object candidate combination 
hypothesis generating means which carries out two or more listing generation of an object 
candidate s combination as a hypothesis from an output of a highest rung surface area extraction 
means, An object size database which stores size data of recognition objects, a two-dimensional 
reference pattern, and a hypothetical validation means to verify the validity of an object 
candidate combination hypothesis which the above-mentioned hypothesis generating means 
generated using information included in a shade original image, An image processing device which 
recognizes based on a hypothesis with the highest evaluation value among two or more 
hypotheses, is provided with an information integration means which unifies this recognized 
picture and distance information of each object obtained by a depth map creating means, and 
outputs three dimensional position information on each object body. 

[Claim 12]A depth map creating means which generates a depth map of two or more loaded 
objects, and a highest rung surface area extraction means to extract highest rung surface area 
of an object located in the highest rung from a depth map, An object candidate combination 
hypothesis generating means which carries out two or more listing generation of an object 
candidate s combination as a hypothesis from an output of a highest rung surface area extraction 
means, An object size database which stores size data of recognition objects, a two-dimensional 
reference pattern, and a hypothetical validation means to verify the validity of an object 



candidate combination hypoi^is which the above-mentioned hypo^Plis generating means 
generated using information included in a shade original image, Recognize based on a hypothesis 
with the highest evaluation value among two or more hypotheses, and it has an information 
integration means which unifies this recognized picture and distance information of each object 
obtained by a depth map creating means, An object transfer equipment which is provided with a 
transfer means which grasps and transfers an image processing device and an object which 
output three dimensional position information on each object body, and transfers an object based 
on an output signal of a described image processing unit. 

[Claim 1 3]An object arrangement reference database which stores data used as a standard of 
object arrangement, A picture which a hypothetical validation means to verify the validity of an 
object candidate combination hypothesis which a hypothesis generating means generated has 
recognized, The image processing device according to claim 1 1 having an object arrangement 
judging means which judges whether it is right arrangement as compared with the above- 
mentioned criterion data, and a warning generation means which warns a worker of a result of a 
judgment when a recognized picture does not consistent with criterion data. 
[Claim 14]The object transfer equipment according to claim 12 which is provided with a transfer 
means which grasps and transfers an image processing device and an object characterized by 
comprising the following, and transfers an object based on an output signal of a described image 
processing unit. 

An object arrangement reference database which stores data used as a standard of object 
arrangement. 

A picture which a hypothetical validation means to verify the validity of an object candidate 
combination hypothesis which a hypothesis generating means generated has recognized. 
An object arrangement judging means which judges whether it is right arrangement as compared 
with the above-mentioned criterion data. 

A warning generation means which warns a worker of a result of a judgment when a recognized 
picture does not consistent with criterion data. 

[Claim 1 5]The image processing device according to claim 1 which is provided with the following 
and characterized by operating so that the above-mentioned actual image reference pattern may 
be used in subsequent recognition operation. 

An actual image reference pattern logging means which starts an imaging range which detects a 
position of the target object from an object size database using an artificial reference pattern 
generated automatically, and is equivalent to the above-mentioned object body in a detection 
position. 

An actual image reference pattern storing means which stores a cut-down actual image 
reference pattern. 

[Claim 1 6]A position of the target object is detected from an object size database using an 
artificial reference pattern generated automatically, An actual image reference pattern logging 
means which starts an imaging range which is equivalent to the above-mentioned object body in 
a detection position, It has an actual image reference pattern storing means which stores a cut- 
down actual image reference pattern, The object transfer equipment according to claim 2 which 
is provided with a transfer means which grasps and transfers an image processing device and an 
object which operate so that the above-mentioned actual image reference pattern may be used 
in subsequent recognition operation, and transfers an object based on an output signal of a 
described image processing unit. 

[Claim 17]A depth map creating means which measures distance distribution from an image input 
means of two or more tiered object bodies, Based on information on a depth map stored in the 
first depth map storing means that stores a generated depth map, and this first depth map 
creating means, at the time of an initial bundle which calculates a position at the time of an 
objective bundle A position calculation means, The second depth map storing means that stores 
a depth map of the remaining cargo after evacuating an object to a position temporarily, A depth 
map comparison means to compare a depth map stored in a depth map storing means of the 



above first with a depth mafi^^red in a depth map storing means above second, An 

image processing device having a position-correction-quantity detection means to determine a 
gripping position of the evacuation above-mentioned object based on a comparison result of this 
depth map comparison means, and to detect a difference of this gripping position and the above- 
mentioned initial gripping position as position correction value. 

[Claim 18]A depth map creating means which measures distance distribution from an image input 
means of two or more tiered object bodies, The first depth map storing means that stores a 
generated depth map, and an object transportation device which grasps an object and moves, At 
the time of an initial bundle which calculates a position based on information on the above- 
mentioned depth map at the time of an objective bundle, a position calculation means, The 
second depth map storing means that stores a depth map of the remaining cargo after grasping 
an object in the above-mentioned gripping position and making it contrast with a position 
temporarily by the above-mentioned object transportation device, A depth map comparison 
means to compare a depth map stored in a depth map storing means of the above first with a 
depth map stored in a depth map storing means of the above second, Based on an output of an 
image processing device provided with an image processing device which has a position- 
correction-quantity detection means to determine a gripping position of an object which 
evacuated [ above-mentioned ] using a comparison result of the above-mentioned depth map, 
and to detect a difference with the above-mentioned initial gripping position as position 
correction value, and an objective transfer equipment, An object transfer equipment which 
transfers an object by an object transfer means. 



[Translation done.] 
* NOTICES * 



JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention relates to the image processing device which recognizes 
the position of the load into which the robot which transfers a cargo automatically, and the 
industrial machine were loaded. 
[0002] 

[Description of the Prior Art]There are some which were indicated by JP,H6-249631,A as an 
example of the image processing device of a means to transfer a cargo automatically. The flow 
chart with which drawing 27 shows the approximate account figure of the procedure of the image 
measuring of the invention and drawing 28 operation, and drawing 29 are the figures showing the 
principle of spatiahcode-izing which used pattern light 

[0003]This image processing device makes applicable to Measurement Division carton box W 
loaded on the palette 1. 

As shown in drawing 29 , when it becomes the slanting upper part of the palette 1 from the 
floodlight 2 and the camera 3 arranged in the central part upper part of the palette 1 and the 
floodlight 2 floodlights various kinds of pattern light serially, The slit pattern light which divides 



measuring space into the wd^P~shaped measurement regions rO-n^^iinated mutually is 
floodlighted. 

A slit pattern floodlights three pattern light of the monochrome binary pattern of A of drawing 
29, B, and C, for example. 

As for white, light hits and a portion and black are portions upon which light does not strike. 
Such a pattern can be made, for example using a dot-matrix electrical-and-electric-equipment 
shutter like a liquid crystal shutter. 

[0004]If the state where light has hit is expressed as "1" and the state where it has not hit is 
expressed as "0", when the pattern A is floodlighted, in drawing 29 , it will be set to 1 and 0 from 
before by halves toward back. In the pattern B, it is set to 1, 0, 1, and 0 from before every [ 4 / 
1/] at order. In the pattern C, it is set to 1, 0, 1, 0, 1, 0, 1, and 0 every [8/1/]. 
[0005]If these three patterns are floodlighted and a picture is picturized, respectively, it can be 
made to correspond to one of the data coded by three bit codes of "000" to "111" about each 
pixel. Such a code is called a spatial code. A wedge-shaped field corresponds to a certain spatial 
code at three-dimensional Jo Sorama. A code will be assigned to the imaging range on the 
objective surface when the object W exists there. On the other hand, since the picture picturized 
with the camera shows whether it is equivalent to which wedge-shaped field if the spatial code 
of a certain pixel on a picture is known, the principle of triangulation will show the height of an 
object surface, i.e., the distance from a camera. Although the kind of pattern was written with 
three kinds, A, B, and C, and the whole picture was divided into eight wedge-shaped fields in this 
explanation, if the kind of pattern is made into eight kinds, the number of wedge-shaped fields 
can be set to 256, and can raise the accuracy of distance information more precisely. That is, 
the distance from the camera of each pixel on a picture is measurable by generating a spatial 
code picture. 

[0006j Drawing 27 is explained according to a flow chart. If a system is started by step ST01, a 
spatial code picture will be generated in step ST02, A spatial code picture as shown in the figure 
(D) is acquired by the upper surface of the cargo in the state of drawing 27 (A), a picture is 
horizontally scanned on the right from the left, and if a field with data with the largest spatial 
code is extracted, the picture a highest rung object carries out [ a picture ] upper surface partial 
load correspondence as shown in the figure (E) will be acquired. In step ST04, grouping of the 
highest rung object area is carried out. When the spatial code is close within the limits of 
predetermined between the pixels which adjoin in a spatial code picture, these fields are judged 
to be the same groups, or grouping is carried out based on change of a grooved portion or the 
spatial code for liking Mabe produced between each cargo upper limb. The three-dimensional 
position of each object is measured by step ST05 which each object by which grouping was 
carried out follows. A number of three-dimensional coordinates of the portion equivalent to the 
verge portion of the object by which grouping was carried out are sampled, and an objective 
centroid position, a posture, and height information are acquired based on them by step ST06. 
Processing is ended by step ST07. Thus, every one cargo is transferable by a robot etc. using 
the position data of the obtained cargo. 

[0007]In this image processing device, all information required for recognition of a cargo is 
acquired from a spatial code picture, For example, it is necessary to generate the depth map of 
the resolution 256x256 or resolution as high as 512x512 pixels. Since the highly precise pattern 
floodlight which has a mechanism to which a floodlighting pattern is changed serially is used, two 
or more floodlighting patterns of each generated in the time series are made to correspond and a 
picture is inputted, a mass image memory is needed. 

[0008]As other conventional examples, Sato published by Institute of Electronics, Information 
and Communication Engineers paper magazine Vol.J71-D.No.7p1240 - 1257 and the contents 
described in the paper "a liquid crystal range finder .. high-speed depth map instrumentation 
system by a liquid crystal shutter .." of Inokuchi are introduced. This art is related with the depth 
map acquisition system by the spatial code-ized method used with the art shown in above- 
mentioned drawing 27 - drawing 29 , and shows drawing 30 t hat principle. The slit pattern by 
reflected binary code is serially projected on an object using the liquid crystal shutter 41, the 
picture corresponding to each pattern is picturized with the camera 3, and a spatial code picture 



is generated. As a pattern, ^^ttern of seven sheets like drawing 4^^Jsed. The principle of 
Measurement Division is the same as that of what is used by the conventional technology of 
above-mentioned drawing 27 ~ drawing 29 . 

[0009]As another conventional technology, the ''stereo-correspondences searching device" 
indicated to JP,H7-103734,A is explained. Drawing 31 is an explanatory view of the hierarchical 
block matching (heuristics of condensation and rarefaction) of this invention. 
Drawing 32 is a flow chart of operation of the invention. 

[0010]Stereo vision is the technique of calculating the distance of a camera and a target point 
from the principle of triangulation by measuring the azimuth difference corresponding to the 
same point on two subjects of a picture inputted from the image input means arranged at several 
different positions. Processing which changes into hierarchical more low resolution the picture 
which two pictures which the picture was inputted in ST1 1 of the flow chart of drawing 32 , and 
were inputted by ST12 were stored in the image memory, respectively, and was stored in ST13 
is performed, and a hierarchy picture is generation ****. Drawing 31 expresses the 
correspondence relation between the Dth hierarchy's picture, and the D+1st hierarchies' picture 
in ** type. In this example, 1/4 field of the Dth hierarchy's picture is made into the D+1st 
hierarchies' picture. In [ a picture is divided into a small block in step ST14, and ] step ST905, 
Initial search positions are calculated by an initial search-positions computer, the corresponding 
points of the block in other pictures are calculated by pattern matching, and, as for each block, 
azimuth difference is calculated by an azimuth difference computer in step ST17 using the 
position information on the corresponding points between two pictures by step ST16. Thus, 
based on the obtained parallax picture, the picture of single step high resolution is used and 
azimuth difference is calculated again. This processing is repeated and corresponding point 
searching to the picture of the same peak resolution as an inputted image is given to the deed 
last.ta.cget 
[0011] 

[Problem(s) to be Solved by the Invention]In the image processing device shown in above- 
mentioned drawing 27 - drawing 29 . All information required for recognition of a cargo is acquired 
from the spatial code picture, For example, it is necessary to generate the depth map of the 
resolution 256x256 or resolution as high as 512x512 pixels. A highly precise pattern floodlight is 
required and moreover what has a mechanism to which a floodlighting pattern is changed serially 
is required for it, It became a large-scale, expensive device, and two or more floodlighting 
patterns of each generated in the time series needed to be made to correspond further, the 
picture needed to be inputted, the mass image memory was also needed, and there was a 
problem used as a large-scale, expensive device. There was the total of the image input time 
which it takes, and many or the problem of cutting. 

[0012]also in the art shown in above-mentioned drawing 30 , since the cargo had been recognized 
only based on a spatial code picture, like the case of drawing 27 - drawing 29 , the big image 
memory was also needed and there was a problem used as a large-scale, expensive device. 
[0013] Drawing 27 - drawing 29 , and the image processing device of drawing 30 , In order to 
acquire all information required for a cargo from a spatial code picture, when an object and a 
neighboring matter object to grasp in a cargo touch densely, Namely, the thing in which a 
boundary with the object which adjoins in a carton box with the small amount of camfering of a 
ridgeline does not appear as a level difference clearly in three dimensions, Or since it was close 
with an adjoining object when it is pouches like the cement bag in which soft contents were 
stored, there was a problem that a boundary was indefinite in three dimensions and it was 
difficult to separate each object individually and to make a transporting means grasp. 
[001 4] Although the image processing device shown in drawing 31 and drawing 32 is searched for 
a stereo-correspondences point at high speed and it aims at gaining a depth map in short time 
with it, Since order searched in the small block unit which the subject in a picture was not 
caused how but was always uniformly set up on the picture from the picture of rougher 
resolution to the picture of dense resolution, when the part which needs high resolution 
information was found beforehand, there was a problem that processing time started for a long 



time conversely. 




[0015]This invention is made in order to solve the above-mentioned problem, and it is a thing. 
It is providing the object transfer equipment equipped with the image processing device which 
does not need the purpose but can grasp an objective three-dimensional position by an easy 
equipment configuration in a short time, and this image processing device. 

[0016] 

[Means for Solving the Problem]A depth map creating means which generates a depth map of 
two or more objects into which an image processing device concerning Claim 1 of this invention 
was loaded, A highest rung surface area extraction means to extract highest rung surface area 
of an object loaded from a depth map, A highest rung object candidate extraction means to 
dissociate separately and to extract an object from highest rung surface area, An object size 
database which stores size data of recognition objects, and a two-dimensional reference pattern 
creating means which generates a standard pattern image on an objective two-dimensional 
picture based on objective size data, A shade original image storing means which stores a shade 
original image inputted from a camera, An object position detecting means which detects an 
objective position using information on a two-dimensional reference pattern and a shade original 
image about a highest rung object candidate extracted individually, It has an information 
integration means which unifies a detection result of an object position obtained by each means, 
and distance information of each object obtained by a depth map creating means. 
[001 7]A depth map creating means which generates a depth map of two or more objects into 
which an object transfer equipment concerning Claim 2 of this invention was loaded, A highest 
rung surface area extraction means to extract highest rung surface area of an object loaded 
from a depth map, A highest rung object candidate extraction means to dissociate separately 
and to extract an object from highest rung surface area, An object size database which stores 
size data of recognition objects, and a two-dimensional reference pattern creating means which 
generates a standard pattern image on an objective two-dimensional picture based on objective 
size data, A shade original image storing means which stores a shade original image inputted 
from a camera, An object position detecting means which detects an objective position using 
information on a two-dimensional reference pattern and a shade original image about a highest 
rung object candidate extracted individually, It has an object transfer means which grasps and 
transfers an image processing device and an object provided with an information integration 
means which unifies a detection result of an object position obtained by each means, and 
distance information of each object obtained by a depth map creating means. 
[001 8]A random texture light projection means which floodlights a texture pattern random 
[ image processing device / concerning Claim 3 of this invention ] in a depth map creating 
means, It comprises a with means corresponding to a stereo image block to carry out with 
correspondence between two pictures which the first image input means and the second image 
input means which input a stereo image, and the first and the second image input means 
picturized. 

[0019]An object transfer equipment concerning Claim 4 of this invention is characterized by 
comprising: 

A random texture light projection means in which a depth map creating means floodlights a 
random texture pattern. 

The first image input means and second image input means that input a stereo image. 
An image processing device which comprised a with means corresponding to a stereo image 
block to carry out with correspondence between two pictures which the first and the second 
image input means picturized. 

An object transfer means which grasps and transfers an object 

[0020]A low resolution depth map creating means in which, as for an image processing device 
concerning Claim 5 of this invention, a depth map creating means generates a depth map with 
coarse resolution, A level difference region extraction means to extract an objective level 
difference region part from a low resolution depth map, It comprises a high resolution depth map 



creating means which gener^P^ a depth map of high resolution to ^^el difference region, and a 
depth map synthesizing means which compounds two depth maps from which resolution of a low 
resolution depth map and a high resolution depth map differs. 

[0021]An object transfer equipment concerning Claim 6 of this invention is characterized by 
comprising: 

A low resolution depth map creating means in which a depth map creating means generates a 
depth map with coarse resolution. 

A level difference region extraction means to extract an objective level difference region part 
from a low resolution depth map. 

A high resolution depth map creating means which generates a depth map of high resolution to a 
level difference region. 

An image processing device which comprised a depth map synthesizing means which compounds 
two depth maps from which resolution of a low resolution depth map and a high resolution depth 
map differs, and an object transfer means which grasps and transfers an object. 

[0022]A high-speed similarity calculation means by which, as for an image processing device 
concerning Claim 7 of this invention, a with means corresponding to a block searches for a 
correspondence image block on either side at high speed, It comprises a high reliability similarity 
calculation means to calculate similarity to high reliability about a pair of a block which is search 
results, and a corresponding block reliability judgment means will judge that have no 
corresponding block if high reliability similarity is below a fixed threshold. 
[0023]An object transfer equipment concerning Claim 8 of this invention is characterized by 
comprising: 

A high-speed similarity calculation means by which a with means corresponding to a block 
searches for a correspondence image block on either side at high speed. 

A high-reliability similarity calculation means to calculate similarity to high reliability about a pair 
of a block which is search results. 

An image processing device which comprised a corresponding block reliability judgment means 
will judge that has no corresponding block if high reliability similarity is below a fixed threshold. 
An object transfer means which grasps and transfers an object. 

[0024]An image processing device concerning Claim 9 of this invention has three or more image 
input means, A with means corresponding to a block chooses two or more kinds of picture pairs 
which chose an inner 2 ** picture of each picture acquired from three or more image input 
means, performs with [ corresponding to a block ], unifies each search results with 
correspondence, and generates a depth map. 

[0025]An object transfer equipment concerning Claim 10 of this invention is characterized by 
comprising: 

An image processing device which has three or more image input means, chooses two or more 
kinds of picture pairs which chose an inner 2 ** picture of each picture by which a with means 
corresponding to a block is obtained from the three or more above-mentioned image input 
means, performs with [ corresponding to a block ], unifies each search results with 
correspondence, and generates a depth map. 
An object transfer means which grasps and transfers an object. 

[0026]An image processing device concerning Claim 11 of this invention, A depth map creating 
means which generates a depth map of two or more loaded objects, and a highest rung surface 
area extraction means to extract highest rung surface area of an object located in the highest 
rung from a depth map, An object candidate combination hypothesis generating means which 
carries out two or more listing generation of an object candidate's combination as a hypothesis 
from an output of a highest rung surface area extraction means, An object size database which 
stores size data of recognition objects, a two-dimensional reference pattern, and a hypothetical 
validation means to verify the validity of an object candidate combination hypothesis which the 
above-mentioned hypothesis generating means generated using information included in a shade 



original image, It recognizes^ped on a hypothesis with the highest^Pluation value among two 
or more hypotheses, and has an information integration means which unifies this recognized 
picture and distance information of each object obtained by a depth map creating means. 
[0027]An object transfer equipment concerning Claim 12 of this invention, A depth map creating 
means which generates a depth map of two or more loaded objects, and a highest rung surface 
area extraction means to extract highest rung surface area of an object located in the highest 
rung from a depth map, An object candidate combination hypothesis generating means which 
carries out two or more listing generation of an object candidate's combination as a hypothesis 
from an output of a highest rung surface area extraction means, An object size database which 
stores size data of recognition objects, a two-dimensional reference pattern, and a hypothetical 
validation means to verify the validity of an object candidate combination hypothesis which the 
above-mentioned hypothesis generating means generated using information included in a shade 
original image, Recognize based on a hypothesis with the highest evaluation value among two or 
more hypotheses, and it has an information integration means which unifies this recognized 
picture and distance information of each object obtained by a depth map creating means, It has 
an image processing device which outputs three dimensional position information on each object 
body, and a transfer means which grasps and transfers an object. 

[0028]An image processing device concerning Claim 13 of this invention, An object arrangement 
reference database which stores data used as a standard of object arrangement, A picture which 
a hypothetical validation means to verify the validity of an object candidate combination 
hypothesis which a hypothesis generating means generated has recognized, It has an object 
arrangement judging means which judges whether it is right arrangement as compared with 
criterion data, and a warning generation means which warns a worker of a result of a judgment 
when a recognized picture does not consistent with criterion data. 

[0029]An object transfer equipment concerning Claim 14 of this invention is characterized by 
comprising: 

An object arrangement reference database which stores data used as a standard of object 
arrangement. 

A picture which a hypothetical validation means to verify the validity of an object candidate 
combination hypothesis which a hypothesis generating means generated has recognized. 
An object arrangement judging means which judges whether it is right arrangement as compared 
with the above-mentioned criterion data. 

An image processing device which has a warning generation means which warns a worker of a 
result of a judgment when a recognized picture does not consistent with criterion data, and a 
transfer means which grasps and transfers an object. 

[0030]An image processing device concerning Claim 15 of this invention, A position of the target 
object is detected from an object size database which stores data used as a standard of object 
arrangement using an artificial reference pattern generated automatically, An actual image 
reference pattern logging means which starts an imaging range which is equivalent to said object 
body in a detection position, It has an actual image reference pattern storing means which stores 
a cut-down actual image reference pattern, and it constitutes so that said actual image 
reference pattern may be used in subsequent recognition operation and it may operate. 
[0031]An object transfer equipment concerning Claim 16 of this invention, A position of the 
target object is detected from an object size database which stores data used as a standard of 
object arrangement using an artificial reference pattern generated automatically, An actual image 
reference pattern logging means which starts an imaging range which is equivalent to an object 
body in a detection position, It has an actual image reference pattern storing means which stores 
a cut-down actual image reference pattern, and has an image processing device constituted so 
that an actual image reference pattern might be used in subsequent recognition operation and it 
might operate, and a transfer means which grasps and transfers an object 
[0032]An image processing device concerning Claim 1 7 of this invention, A depth map creating 
means which measures distance distribution from an image input means of two or more tiered 
object bodies, Based on information on a depth map stored in the first depth map storing means 



that stores a generated depi^^iap, and this first depth map creatin^^ans, at the time of an 
initial bundle which calculates a position at the time of an objective bundle A position calculation 
means, The second depth map storing means that stores a depth map of the remaining cargo 
after evacuating an object to a position temporarily, A depth map comparison means to compare 
a depth map stored in the first depth map storing means with a depth map stored in the second 
depth map storing means, A gripping position of an object evacuated based on a comparison 
result of this depth map comparison means is determined, and it has a position-correction- 
quantity detection means to detect a difference of this gripping position and an initial gripping 
position as position correction value. 

[0033]An object transfer equipment concerning Claim 18 of this invention, A depth map creating 
means which measures distance distribution from an image input means of two or more tiered 
object bodies, The first depth map storing means that stores a generated depth map, and an 
object transportation device which grasps an object and moves, At the time of an initial bundle 
which calculates a position based on information on the above-mentioned depth map at the time 
of an objective bundle, a position calculation means, The second depth map storing means that 
stores a depth map of the remaining cargo after grasping an object in a gripping position and 
making it contrast with a position temporarily by an object transfer means, A depth map 
comparison means to compare a depth map stored in the first depth map storing means with a 
depth map stored in the second depth map storing means, It has an image processing device 
which has a position-correction-quantity detection means to determine a gripping position of an 
object evacuated using a comparison result of a depth map, and to detect a difference with an 
initial gripping position as position correction value, and a transfer equipment which grasps and 
transfers an object. 
[0034] 

[Embodiment of the Invention] 

Drawing 2 and the picture of each generated stage are shown for the flow chart which shows 
drawing 1 and a flow of operation for the block diagram showing the composition of embodiment 
1 . embodiment 1 . in drawing 3 . Here, an object is explained as a state where the thing of identical 
shape and the same size is stacked, supposing polyhedral form [, for example like a carton box ] 
whose object which should be recognized that explanation of operation is easy to be understood 
is. 

[0035]The image input means which comprised two cameras which 1 1 set the predetermined 
interval and have been arranged in drawing 1 , The depth map creating means which generates a 
depth map from the picture in which the image input means 1 1 picturized 1 2, A highest rung 
surface area extraction means by which 1 3 extracts a highest rung side from a depth map, and 

14 A highest rung object candidate extraction means, The shade image storing means in which 

15 stores an original image, and 16 An object size database, The two-dimensional reference 
pattern creating means which generates the reference pattern as a two-dimensional pattern 
automatically based on the information for which 1 7 was stored in the object size database 1 6, 
The object position detecting means from which 18 detects a two-dimensional object position, 
and 19 are information integration means which unify the distance information of the object 
position detected by the object position detecting means 1 8, and a depth map. 

[0036]The original image in which the image input means 1 1 picturized (a) of drawing 3 , the 
highest rung object area where the highest rung surface area extraction means 13 extracted (b), 
The template of the reference pattern in which (c) was generated by the two-dimensional 
reference pattern creating means using object size data, the mimetic diagram showing one of the 
candidates by whom (d) was extracted from the highest rung object area, and (e) show a 
positioning situation by the law by template matching. 

[0037]By step ST101, starting of a device will input into the depth map creating means 12 the 
picture of the recognition object shown in drawing 3 (a) by the image input means 1 1. A depth 
map is generated by the depth map creating means 12 in step ST102. As a creating means of a 
depth map, there is the section coding method or stereo-correspondences heuristics. A highest 
rung object area with the height which is equivalent to the object of the highest rung shown in 
drawing 3 (b) by the highest rung object area extraction means 13 by step ST103 is extracted. 



The original image photoed HKhe image input means 1 1 by step Slwf is stored in the shade 
image storing means 15, and in step ST105 by the two-dimensional reference pattern creating 
means 17. The reference pattern as a two-dimensional pattern is automatically generated based 
on the information stored in the object size database 16. This reference pattern is called a 
template, and as shown in drawing 3 (C) t the template is an outline plate expressing an objective 
contour part. 

[0038]In step ST106, a candidate is extracted from the object of the highest rung object area 
expressed with the binary being visible to a rectangular pattern on a picture by detecting the 
peripheral area at which it crosses right-angled. Since the resolution of a depth map is coarse as 
above-mentioned, a candidate's position is inaccurate. In step ST107, said object candidate is 
positioned by the object position detecting means 1 7, said two-dimensional reference pattern is 
used for positioning, and processing by the template-matching method is made. However, since 
the rough position is already detected in the stage of candidate extraction, a candidate detection 
position to the processing which searches only the neighborhood very much is enough as 
matching. Therefore, template matching can also be performed at high speed. The situation of 
positioning is shown in drawing 3 (e). If an object position is detected, the two-dimensional 
object position information will be unified with the distance information by said depth map 
creating means 1 2 by the information integration means 1 9, and will be outputted as a result with 
final it. 

[0039]In step ST108, it judges whether all the objects were detected, if it has not detected, it 
performs again from step ST106 among processing flows, and a series of processing step ST106 
and ST107 are carried out about another object candidate. If all the objects are detected, 
recognition processing will be terminated by step ST109. It is performing the range of that 
pattern searching in the form which generated the depth map coarsely by this invention, 
extracted the objective candidate based on that result as above, and limited dramatically 
template matching whose detailed detecting position is a two-dimensional general-purpose 
processing method, The device scale of a depth map generating device can be made small. 
[0040]It may be the method that resolution is made coarse and a spatial code-ized method is 
used as a depth map creating means, or a method like stereo vision or the optical cutting 
method by slit light scan, and what is necessary is just a device with which the depth map of 
coarse resolution may be generated. 

[0041] Although the example of positioning by template matching based on profiling information 
was shown, the method of considering an objective outline to be linear combination similarly, and 
performing alignment for every neighborhood as a straight line may be used. The contents of the 
object size database may be used and the usual two-dimensional template matching may be 
used. Although it did not show clearly, especially concerning the data storage form used inside 
template matching processing, the method of enumerating and storing the position of the edge of 
a contour part other than the method of storing as a two-dimensional picture in an inside in one 
dimension may be used. 

[0042]When extracting the candidate of a highest rung object, the technique of using the corner 
part from the highest rung surface area information acquired from the depth map was shown, 
but. In addition, for example, the same effect is done so even if it applies the method of 
detecting a position coarsely by the method of template matching of a binary using the template 
as a depth map of the binary prepared separately, using the depth map of the above-mentioned 
binary. 

[0043]The operation flow chart of drawing 2 may be an example, and as long as the input/output 
relation of each means shown in drawing 1 is proper, and is clear and it has it, it may be another 
processing flow. For example, as for the step of depth map generation and a shade original image 
input, whichever may be performed first. 

[0044]Although the above was the explanation which assumed the polyhedron, i.e., the single 
variety object of a box-like object, as an object body which should be recognized, even if it is a 
saccate object like a cement bag and a rice bag, image recognition can be realized with the same 
composition, for example, without changing the composition of this invention in any way. Next, 
about a situation in case a bag-like object object recognizes, the difference with the case in the 



above-mentioned case shaH^bject is explained. 

[0045]In step ST105 of drawing 2 , a two-dimensional reference pattern is automatically 
generated by the two-dimensional reference pattern creating means 16. This is equivalent to the 
template generation in template matching for positioning an object. In the case of a bag-like 
object object, it is insufficient unlike the case shape object — the verge changes — just to have 
taken out the contour part of a rectangle like drawing 3 as said reference pattern, since shape 
was unstable. In this case, the partial template which expressed only the objective corner part 
with the outline, or the straight-line contour part template expressing an objective side part is 
generated automatically. In any case, it is generated with reference to the contents of the object 
size database 1 5 which stored the size of the bag-like object object. 

[0046]In the case of a bag-like object object, in object candidate extraction of step ST106, it is 
difficult to extract a candidate using the information on an edge etc. which were described in the 
top and at which it crosses right-angled. In this case, consider that the picture as which the 
highest rung object area was expressed is a binary format image, and the object template of a 
binary is automatically generated from the information about the bag-like object object model 
stored in the object size database 15, Rough candidate extraction is attained by carrying out 
binary template matching of these coarsely. 

[0047]In step ST107, although an objective position is detected, the outline template of the 
corner part of the above objects or a rectilinear side edge portion is matched with the edge 
image obtained from the inputted image as a partial template here. An objective position can be 
operated to the same grade as the recognition of as opposed to a case shape object also about 
an object saccate as mentioned above judged and calculated synthetically from the position 
which two or more partial templates matched as a result of matching. 
[0048]Although the situation where the object of single variety was stacked was assumed in 
embodiment 1 . explained above, The size data of two or more objects is stored in the object size 
database 16, Jt is carrying out operation it is supposed that it is an object which generates 
automatically two or more two-dimensional reference patterns, and makes said two or more 
reference patterns of all match in the object position detecting means 17, and in which a 
template with the highest similarity exists, It can be made to operate accurately also to the 
situation where two or more objects of a different kind are stacked. 

[0049]By building the image processing device of the above-mentioned composition into an 
object transfer equipment, it becomes an object transfer equipment which does not need a highly 
precise pattern floodlight and a mass image memory, and can also perform image input time in a 
short time and which operates correctly. 

[0050]The flow chart which shows drawing 4 and a flow of operation for the block diagram 
showing the composition of embodiment 2. embodiment 2. is shown in drawing 5 . It is an 
explanatory view in which drawing 6 shows the explanatory view of a random dot pattern 
exposure, and drawing 7 shows the method of the with processing corresponding to a block from 
a stereo image. This embodiment 2. carries out the portion of the depth map creating means of 
embodiment 1. with stereo correspondences by random texture pattern floodlighting, and 
generates a depth map, this point is different and other composition is the same as embodiment 
1. 

[0051]In drawing 4 , the random texture pattern light projection means in which 20 floodlights a 
random dot pattern, and 21 are image input means, and comprise the first image input means 21a 
and the second image input means 21b. 22 is a with means corresponding to a stereo image 
block. Other highest rung imaging range extraction means 13, highest rung object candidate 
extraction means 14, shade original image storing means 15, object size databases 16, two- 
dimensional reference pattern creating means 17, object position detecting means 18, and 
information integration means 19 are the same composition as embodiment 1. 
[0052]According to the flow chart of drawing 5 , operation is explained about this embodiment 2. 
below. If a power supply is turned on by step ST201, the power supply of the random texture 
pattern light projection means 20 will be turned on, and a random dot pattern will be projected to 
a recognition object thing. A random texture pattern light projection means floodlights a random 
dot pattern with the pattern floodlight 30 to the subject which should be recognized, as shown in 



drawing 6 (a). A pattern floo^^it is installed downward above obje^fc like drawing 6 , and 
projects a random dot as shown in drawing 6 (b) on a recognition object In embodiment 2., 
although it is a carton box, the object body which should be recognized can be recognized, for 
example, even if it is a saccate object like a cement bag. A random dot is projected on the upper 
surface of a subject, and the stereo image of the picture of the couple picturized by the first 
image input means 21a and second image input means 21b is inputted in step ST203. A 
predetermined distance makes an optic axis and this stereo image is picturized with two 
cameras, the same resolution and the same focal distance. 

[0053]Next, a random dot pattern is explained. The random dot shown in drawing 6 (b) comprises 
resolution of 128x128 at this embodiment 2., by the computer, each pixel is a square, white or a 
black value is assigned for every pixel in uniform random numbers, and the ratio of white and a 
black pixel number has become about 1:1. The mechanism in which the focus of a projection 
pattern is adjusted is formed in the pattern floodlight 30, and a focus is adjusted so that it may 
focus by an object surface based on the data, when a rough distance of a floodlight and an 
object body is known. When distance is not known at all beforehand, it operates so that a focus 
may suit in the distance adjusted a priori. 

[0054]When the input of a stereo image pair finishes, the light projection means 20 of a random 
texture is turned off by step ST204. Next, a stereo image is processed for a stereo image by the 
with stage 22 corresponding to a block by step ST205. Drawing 7 (a) and (b) is a picture of the 
couple of the stereo image which photoed the object body. Suppose that drawing 7 (a) is called a 
left image and drawing 7 (b) is called a right image. Block matching is performed from dividing a 
right image into a lattice-like small block, as shown in a figure. Although the above-mentioned 
random dot pattern is actually projected on the left and a right image, in order [ for which the 
block bR which it is taking notice of among two or more small blocks divided and generated now 
is called a noticing block ] to simplify a figure, the pattern is not drawn here. It searches for the 
position on the left image corresponding to this noticing block bR. It looks for the pattern which 
has the same pattern as bR in the search range set up separately. Search by accumulation 
difference absolute value minimization is adopted as the method of search. This piles up the 
inside of the search range on a left image one by one, moving the noticing block bR, and the 
similarity makes it corresponding points with the position which becomes the best. Under the 
present circumstances, an accumulation difference absolute value is used as evaluation of 
similarity. For example, in a noticing block, when bR (i, j) and a left image are set to bL (i, j) and 
block size is made into NxN, accumulation difference absolute value S SAD (dx, dy) in the position 

(dx, dy) on a left image is expressed with (the formula 1). In this embodiment 2., it is N= 16. 

[0055] 

[Equation 1] 

5sxD(d.,d;) = EEiMrf« + ».^ + ^-M«.j)l 

[0056]S SAD for which it asked by (the formula 1) — the minimum — becoming (dx, dy) — it 

means that the block bL on the left image corresponding to the noticing block bR was found by 
detecting The stereo method is a method of making the difference into azimuth difference, being 
a principle of triangulation and acquiring the distance from a camera to an object from the 
position during the block acquired by carrying out in this way. With processing corresponding to a 
series of blocks explained above is repeatedly performed to all the small blocks on a right image, 
it searches for the position on a left image corresponding for every block, and a depth map is 
generated. 

[0057]It is the same as embodiment 1. after this. In step ST207 which the field which is 
equivalent to a highest rung object face from a depth map by the highest rung surface area 
extraction means 13 is extracted in step ST206, and continues. The shade original image 
picturized by the first image input means 21a or the second image input means 21b is stored in 
the shade original image storing means 15. The random dot pattern is not projected with the 
thing natural at this time. In step ST208, a two-dimensional reference pattern is automatically 



generated by the two-dime^^ial reference pattern creating mean^Pr using the size data of 
the recognition objects stored in the object size database 1 6. 

[0058]In step ST209, a picture from which the above-mentioned highest rung surface area was 
extracted is divided into two, a highest rung side and the other field, and is binary-ized, and one 
of the highest rung object candidates is, extracted by the highest rung object candidate 
extraction means 14. In step ST210, a precise position of candidate objects is measured and 
detected by the object position detecting means 18 [ near / which was extracted / one object 
candidate's position ] using shade original image information stored in the above-mentioned two- 
dimensional reference pattern and the object position detecting means 15. At Step 21 1, a two- 
dimensional position of determined candidate objects, Until it judges that it was unified with said 
depth map information by the information integration means 19, and all the objects have been 
recognized by step ST212 by it, Processings from step ST209 to ST211 are repeated, and if 
judgment of step ST212 is judged that all the objects have recognized, it will be eventually 
outputted as objective three-dimensional information. 

[0059]If it is judged that all the objects have been recognized by processings from step ST209 to 
ST21 1, processing will be ended by step ST213. What an objective position became final and 
conclusive one by one based on a binary-ized depth map from which the above-mentioned 
highest rung surface area was extracted is eliminated, and a judgment of whether all the objects 
have been recognized is performed by investigating whether highest rung surface area which 
moreover remains on a picture exists. 

[0060]As explained above, in this embodiment 2. Since a random dot pattern is floodlighted to 
recognition objects, even if it is a plain carton box in which a pattern does not exist, for example 
in the surface, it is possible to obtain distance data in surface each of that position — an object 
surface — a position of an address label etc. — it is possible to obtain a stereo image which is 
not influenced by unfixed texture. Conducts matching for stereo-correspondences attachment 
can also apply simple block matching. 

[0061] Although a 128x1 28-pixel random dot pattern was projected to a camera view as 
resolution of a camera in this embodiment 2., Although it was still finer, a coarse dot pattern 
could be projected depending on size of a recognition object and size of 16x16 pixels was 
adopted as block size of block matching, 8x8 pixels, 32x32 pixels, etc. may be sufficient. Shape of 
a block may not necessarily be a square, either. Although a search range at the time of matching 
was set as a rectangle by drawing 7 , it is still the same as general stereo correspondences that 
the reliability of matching can be raised or processing time can be shortened of it by making it 
change variously according to a situation. 

[0062]In this embodiment 2., although a monochrome binary square dot was used as a random 
dot pattern, they may be a dot pattern which attached a shade, for example, and the colored 
pattern. Although an example which may use it combining a mark of shape with various various 
sizes also about shape, and projects a pattern from the perpendicular upper part towards right 
under about geometric physical relationship of a pattern floodlight and an object body to an 
object was shown, Even if it projects from across, it is a thing which a depth map can detect 
similarly. 

[0063]Although an example using a dot pattern which generated a position random as a pattern 
to floodlight was shown, When searching for corresponding points in block matching processing 
and it considers becoming almost horizontal search, even if it projects a random vertical slit 
group of a cycle, or a random vertical slit group of width as a pattern, for example, it cannot be 
overemphasized that same effect is done so. 

[0064]Although a constitution method of a pattern floodlight was not explained in particular in 
detail, As conventional technology showed, for example, from it not being necessary to change a 
projection pattern while high degree of accuracy being unnecessary for projecting position 
accuracy of a random dot, and being processing, A device of easy unnecessary for example, 
composition like the usual slide show machine for home use is enough as a complicated 
projection device like a liquid crystal projector. This is one of the advantages on an equipment 
configuration of this invention. 

[0065]Embodiment 2. explained operation as recognition objects supposing an object of a carton 



box, the shape of i.e., a hancWce piece, as already stated, but. EveWFit is an object of other 
shape, for example, a saccate object like a cement bag, composition of this invention can 
generate a depth map easily, and a three-dimensional position of a subject can be measured by a 
recognition procedure in said this example. About subsequent processings, it is the same as that 
of working example of the 1st invention as mentioned above than depth map generation. That is, 
final object position detection is possible by having an objective corner part and a straight-line 
contour part as a two-dimensional reference pattern, and unifying a positioning result with each 
recognition object. Thus, this invention can recognize objective three-dimensional information 
not only when objective shape is a polyhedron, but in the time of the shape and others like a bag. 

[0066]A flow chart which shows drawing 8 and a flow of operation for a block diagram showing 
composition of embodiment 3. embodiment 3. is shown in drawing 9 . Drawing 10 is an explanatory 
view of a situation where a level difference region part is extracted from a low resolution depth 
map, and only a level difference region part of a high resolution depth map carries out with 
stereo correspondences of high resolution. In drawing 8 , 13-19 have the same function as 
embodiment 2., and explanation is omitted. A with means corresponding to a low resolution block 
by which 31 generates a depth map of a low resolution from a stereo image which the image 
input means 21 picturized with a low resolution, A level difference region extraction means by 
which 32 extracts a level difference region with a low resolution, a with means corresponding to 
a high resolution block by which 33 generates a depth map of high resolution about a level 
difference region part extracted from a picture of a low resolution, and 34 A low resolution depth 
map, It is a depth map synthesizing means which compounds a high resolution depth map of a 
level difference region part extracted from this depth map. 

[0067]If a power supply is turned on and it starts by step ST301, by step ST302, a lamp power 
supply of the random texture pattern light projection means 20 will be turned on, and a random 
dot pattern will be projected to a recognition object thing. In step ST303, a stereo image of a 
picture of a couple is inputted into the with means 31 corresponding to a low resolution block, 
and the with means 32 corresponding to a high resolution block by the image input means 21 
which comprises a camera of a couple. A stereo image turns off the random texture pattern light 
projection means 20 by step ST304, after an input finishes. In step ST305, a shade image of an 
object body is stored in a shade image storing means 15 from the first image input means 21a or 
second image input means 21b. 

[0068]In step ST306, a stereo image is processed by the low resolution block matching means 
31. Drawing 1 0 (a) is the figure which expressed the low resolution depth map portion A obtained 
by the with means 31 corresponding to a low resolution block in ** type. Although a CCD 
camera with a resolution of 512x512 pixels is used as an image input means, It is obtained 
because a 32x32-pixel depth map shall be generated as a low resolution depth map, and a 
method of block matching shall be performed in a method shown by embodiment 1., and a similar 
way, for example, block size shall be 16x16 pixels. In step ST307, the level difference region 
extraction means 32 extracts the level difference region portion B of a subject based on the 
above-mentioned low resolution depth map. A mimetic diagram of the level difference region 
portion B is shown in drawing 1 0 (b). In step ST308, a depth map of high resolution is generated 
more by the with means 33 corresponding to a high resolution block only about the above- 
mentioned level difference region portion (shadow area of B-A). In this case, high resolution is 
128x128 pixels. While this processing sets block size as 8x8 in block matching processing and 
shifts 4 pixels of blocks at a time, it is obtained by detecting corresponding points, and the depth 
map C of a level difference region portion is shown in drawing 10 (c). In drawing 10 (c), a level 
difference region of an object in which a shadow area (within the limit [ of B ]) was obtained from 
a low resolution depth map, and a gray portion (within the limit [ of C ]) are portions equivalent 
to a level difference region portion of a depth map newly obtained as a result of high resolution 
depth map generation. In step ST309, the above-mentioned low resolution depth map and a high 
resolution depth map are compounded by the depth map synthesizing means 34, and a depth 
map of resolution of 128x128 like drawing 1 0 (d) is obtained. 

[0069]It is processed like embodiment 2. after step ST310. By the highest rung surface area 



extraction means 13, in SteT^O, it is extracted from a depth map^Pighest rung field 
equivalent to a highest rung object face, and in step ST31 1. A two-dimensional reference pattern 
is automatically generated by the two-dimensional reference pattern creating means 1 7 using 
size data of recognition objects stored in the object size database 16. In step ST312, a picture 
from which the above-mentioned highest rung surface area was extracted is divided into two, a 
highest rung side and the other field, and is binary-ized, and one of the highest rung object 
candidates is extracted by the highest rung object candidate extraction means 14. In step 
ST313, a precise position of candidate objects is measured and detected by the object position 
detecting means 18 [ near / which was extracted / one object candidates position ] using the 
above-mentioned two-dimensional reference pattern and the above-mentioned shade original 
image information. Thus, a two-dimensional position of determined candidate objects is unified 
with depth map information on high resolution compounded [ above-mentioned ] by the 
information integration means 19, and is eventually outputted as objective three-dimensional 
information by it. In step ST314, by processing of step ST312 and ST313. If an object which will 
be that processing is ended by step ST315 and will not be recognized if it is judged that it 
carried out by making a judgment of whether all the objects have been recognized and no is 
judged to still exist, processing which returns to step ST312 and ST313 and extracts an object 
candidate will be repeated. What an objective position became final and conclusive one by one 
based on a binary-ized depth map from which the above-mentioned highest rung surface area 
was extracted is eliminated, and a judgment of whether all the objects have been recognized is 
performed by investigating whether highest rung surface area which moreover remains on a 
picture exists. 

[0070]As mentioned above, in order that this embodiment 3. may obtain a depth map of high 
resolution eventually, A depth map of a low resolution is obtained beforehand for a short time, 
and it can decide to limit to a field equivalent to an objective step part, and to perform 
processing with stereo correspondences of high resolution, and can make it possible to generate 
a depth map of high resolution by little calculation time, and an object candidate s extraction 
precision etc. can be raised. 

[0071] Although a low resolution depth map used 32x32 pixels and a high resolution depth map as 
128x128 pixels, Different resolution from this may be set up in consideration of processing time 
permitted, a size of an object body to recognize, etc., and a merit by time of low resolution depth 
map generation of high speed processing and combination of processing with high resolution 
stereo correspondences is not lost. 

[0072]Although it had composition by making a stereo image of a low resolution depth map 
generate time, and a stereo image of a high resolution depth map generate time into the same 
picture, Block matching may be performed based on a degeneration picture which acquired a 
picture of full resolution (the same resolution as CCD camera resolution) by degenerating one 
half, 1/4, etc. as a low resolution stereo image. A lens of a CCD camera of the first and the 
second image input means 21 is made to zoom in a high resolution depth map generate time, and 
it may be made to picturize more a step part of an object in a low resolution depth map in 
details. 

[0073]Although a random dot pattern projected on an object body was used as a fixed pattern, A 
dot pattern floodlight of two kinds of different sizes is prepared, big dot pattern projection is 
performed to a low resolution depth map generate time, and if it changes and carries out so that 
smaller dot pattern projection may be performed to a high resolution depth map generate time, a 
high-precision depth map will be obtained. 

[0074]A flow chart which shows drawing 1 1 and a flow of operation for a block diagram showing 
composition of embodiment 4. embodiment 4. is shown in drawing 12 . In drawing 1 1 , 13-21 have 
the same function as embodiment 2., and explanation is omitted. As for 41a, the first image 
storing means and 41b of a high-speed similarity calculation means and 43 are [ a corresponding 
block reliability judgment means and 45 ] depth map storing means a high reliability similarity 
calculation means and 44 the second image storing means and 42. 

[0075]If a power supply is turned on by step ST401 and a device is started, a power supply of 
the random texture pattern light projection means 20 will be turned on by step ST402, and a 



random dot pattern will be fleeted to a recognition object thing. HRep ST403, a stereo image 
of an object body is picturized by the first image input means 21a and second image input means 
21b, and it is inputted into the first image storing means 41a and second image storing means 
41b by them, respectively. For a start, CCD of the resolution with two same cameras of the 
second image input means 21a and 21b is used, it is equipped with a lens of the same focal 
distance, and an optic axis is arranged at a predetermined distance. After an image input, a 
power supply of the random texture light projection means 20 turns off by step ST404, and a 
random dot pattern projected on an object disappears. In step ST405, a picture on which a 
random dot is not projected by the first image input means 41a is picturized, and it is stored in 
the shade original image storing means 1 5. This picture is used for object position detection 
later. 

[0076]For a start, the second image input means 21a and 21b is usually arranged on the horizon 
in stereo ** at right and left, and is made to call a right camera the first image input means 21a, 
and to call a left camera the second image input means 21b. Suppose that a picture stored in a 
right image and the second image storing means 41b in a picture stored in the first image storing 
means 41a is called a left image in connection with it. 

[0077]In step ST406, the high-speed similarity calculation means 42 performs block matching at 
high speed based on a stereo image stored in the first and the second image storing means 41a 
and 41b. In stereo vision, block matching considers it as a small region (block) which divided a 
unit with correspondence in the shape of a lattice, and carries out a picture on either side with 
correspondence for every block. It is as having indicated block matching to embodiment 1 . Under 
the present circumstances, an accumulation difference absolute value is used as evaluation of 
similarity between two image blocks. For example, in a noticing block, when bR (i, j) and a left 
image are set to L (i, j) and block size is made into NxN, accumulation difference absolute value 
S SAD (dx, dy) in a position (dx, dy) on a left image is expressed with (the formula 2). 

[0078] 
[Equation 2] 

SsAD(4.,4i) = EEIM*-H,^ + i)-W'J)l- (it2) 

[0079]To a certain bR, it searches for L (left) picture and S SAD detects the position (dx, dy) 

which becomes the minimum. In this way, the block bl_ on the left image corresponding to the 
noticing block bR is detected. If the pair of a corresponding block is discovered, the similarity of 
high reliability will be calculated by the above (formula 2) by the high-reliability similarity 
calculation means 43 by step ST407 to the pair. A left image is not scanned at this time. It 
receives that (the formula 2) could be evaluated (dx, dy), and the following (formula 3) estimates 
similarity. Generally S C0RR is called a normalization cross correlation function. 

[0080] 
[Equation 3] 
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[0081](The formula 3) calculates similarity more exact compared with (the formula 2), and 
reliable. Obtained similarity S C0RR is stored in the depth map storing means 45 with the azimuth 

difference obtained from the with result corresponding to the above, i.e., distance information. 
[0082]In step ST408, by the corresponding block reliability judgment means 44. the above — high 
reliability similarity is set up beforehand and it is compared with the similarity threshold stored in 
the inside of a computer, when similarity is large enough, it is judged with with [ corresponding to 
the right ] having been made, and when similarity is smaller than a threshold, it is judged with it 
having been with the mistaken correspondence. A decision result is stored in the depth map 
storing means 45. When it carries out with the correspondence using similarity high-speed about 
all the blocks of a right image, and the similarity of high reliability and reliability with 
correspondence is not judged by step ST409 continuing, the processing more nearly same than 
processing step ST406 is repeated again. 

[0083]It is processed like embodiment 2. after step ST410. By the highest rung surface area 
extraction means 13, in Step 410, it is extracted from a depth map by the highest rung field 
equivalent to a highest rung object face, and in step ST41 1. A two-dimensional reference pattern 
is automatically generated by the two-dimensional reference pattern creating means 17 using 
the size data of the recognition objects stored in the object size database 16. In step ST412, the 
picture from which the above-mentioned highest rung surface area was extracted is divided into 
two, a highest rung side and the other field, and is binary-ized, and one of the highest rung 
object candidates is extracted by the highest rung object candidate extraction means 1 4. In step 
ST413, the precise position of candidate objects is measured and detected by the object 
position detecting means 18 [ near / which was extracted / one object candidate s position ] 
using the above-mentioned two-dimensional reference pattern and the above-mentioned shade 
original image information. Thus, the two-dimensional position of the determined candidate 
objects is unified with the depth map information on the high resolution compounded [ above- 
mentioned ] by the information integration means 19, and is eventually outputted as objective 
three-dimensional information by it. In step ST414, by processing of step ST412 and ST413. If it 
is judged that the object which processing is ended by step ST415 and is not recognized still 
exists if it is judged that it carried out by making a judgment of whether all the objects have 
been recognized and no, the processing which returns to step ST412 and ST413 and extracts an 
object candidate will be repeated. 

[0084]Above, like, by this embodiment 4., when carrying out a stereo image with correspondence 
by a block unit, By asking for the similarity of a corresponding block precisely by a means to 



perform picture search usiflw high-speed similarity evaluation mel^ and to evaluate high 
reliability similarity only once first about a pair of a corresponding block which was able to be 
found, Search processing which time requires can be performed at high speed, and a 
corresponding block can perform a judgment of being the right by high reliability eventually. 
[0085]Although normalization cross correlation was used as a similarity calculation equation of 
high reliability in this embodiment 4., using an accumulation difference absolute value as a high- 
speed similarity calculation equation, For example, the maximum of an absolute value of a 
difference of each pixel value during a block may be used as high-speed similarity, or total of a 
square of a difference may be used as high reliability similarity. Essence of embodiment 4. takes 
effect with combination of a similarity calculation means which attached greater importance than 
to reliability to rapidity, and a similarity calculation means with the reverse characteristic. 
[0086]In high-speed similarity calculation and high reliability similarity calculation, although this 
embodiment 4. used each pixel value of an image block similarly, As a pixel used at the time of 
high-speed similarity calculation was called from a block 1/2 or 1/4 by infanticide operation, it 
may limit and choose, In that case, even if a similarity evaluation type used for the two above- 
mentioned kinds of similarity calculation even if is the same, since high-speed similarity 
calculation is performed at high speed, same effect is done so. 

[0087]That this embodiment 4. performs all the processings by a computer A premise, When 
environment where similarity calculation of a certain kind is performed at high speed by available 
special hardware is provided, for high-speed similarity calculation, similarity may be calculated by 
a method by which another high-reliability is secured using the hardware at the time of high 
reliability similarity calculation. 

[0088]A flow chart which shows drawing 1 3 and a flow of operation for a block diagram showing 
composition of embodiment 5. embodiment 5. is shown in drawing 14 . In drawing 13 , 13-20 have 
the same function as embodiment 2., and explanation is omitted. 51 is an image input means and 
the first image input means 51a, the second image input means 51b, and 51cthe third three 
image input means have it. 52 is a with means corresponding to a stereo image block. 
[0089]When a power supply is turned on by step ST501 and a device starts, a random texture 
pattern light projection means is turned on by step ST502, In Steps ST503-ST505 on which a 
random dot pattern is projected to a recognition object thing, a picture of three sheets is 
inputted one by one by the first image input means 51a, the second image input means 51b, and 
the third image input means 51c. What has the same optical specification which the three image 
input means 51a, 51b, and 51c are CCD cameras, and these three cameras are the same 
resolution, and was equipped with a lens of the same focal distance is used. Arrangement of a 
camera is arranged in parallel so that an optic axis of each camera may be on the same flat 
surface on space and no optic axis may cross. Here, three cameras will be called for 
convenience a left camera, a center camera, and a right camera, respectively. Distance between 
optic axes arranges an interval of a left camera and a center camera equally to an interval of a 
center camera and a right camera. This camera arrangement is equivalent to having arranged the 
3rd camera in the center of two stereo arrangement cameras in above-mentioned embodiment 2. 
-4. 

[0090]A picture is stored in an image storing means which is a different image storing means, 
respectively, a lamp power supply of the random texture pattern floodlight 20 turns it off by step 
ST507, and a random dot pattern of an object surface disappears at the same time an image 
input is completed. In Step 407, a shade image of a subject is picturized by the second central 
image input means 51b, and it is stored in the shade original image storing means 15 by it. 
[0091]In step ST508, the with means 52 corresponding to a stereo image block performs 
processing with correspondence of a stereo image. About flowing into this processing, a flow 
chart of detailed operation is shown in drawing 15 . Stereo-correspondences attachment 
processing starts by ST508-1, and step ST508-2 of the beginning is searched for corresponding 
points between a picture by the first image input means 51a (left camera), and a picture by the 
second image input means 51b (center camera). It is with processing corresponding to a block of 
two pictures, and this processing is performed like processing shown by the above-mentioned 
Embodiment 2. An image pick of a center camera is divided into a block small region, and this 



embodiment 5. is searched^^corresponding points on a left camd^^br every block. Drawing 16 
shows a situation of a with corresponding to a block between these two pictures in ** type. 
Drawing 1 6 (a) shows a picture in which a carton box as recognition objects is reflected. In the 
case of a packed-up carton box, a thing on a transparent film is often stuck on the surface. In 
that case, a block judged like drawing 1 6 (b) to be information lack may occur by light from the 
pattern floodlight 20 or other indoor lighting systems, especially irregular reflection light. With 
this information missing part, for example in the center camera 51b, there is the state where it 
has happened in the left camera 51a although scattered reflection has not happened to a tape 
part, and a fact that an image pattern corresponding to the block concerned cannot discover in a 
picture of another side occurs. Processing in this state is performed by judging whether it is an 
information lack block in step ST508-3. 

[0092]In step ST508-4, with [ corresponding to a block ] is performed between the second 
picture that a center camera picturized, and a right camera or the third picturized picture. A 
picture by a center camera is divided into a block, and it searches for a point of corresponding 
for every block, on a right camera picture. An information lack block occurs like the above- 
mentioned corresponding point searching also at this time. In step ST508-5, information missing 
data of the above-mentioned left camera 51a and the center camera 51b is together put for 
information about a point [ missing / information ] acquired in combination of the above- 
mentioned center camera 51b and the right side camera 51c. At this time, there is no direct 
relation between a position of an information lack block in a left-central pair and a position of an 
information lack block in a central-right pair in any way. Also in which pair, since a left or right 
camera picture top is searched on the basis of a picture of the center camera 51b, information 
lack block information of each pair is given by a block unit on a center camera picture, and can 
be compared, easily. 

[0093]If it judges that a block judged as information being missing in a left-central pair now is not 
information Jack in a central-right pair, it will suppose that it is not the block concerned 
information lack, and will be calculated using a pair which is not information lack as the parallax 
information. When both pairs are judged to be information lack, the block concerned is judged as 
information being missing, and parallax information is not stored. Same processing is performed 
to a whole block of a center camera, and stereo-correspondences attachment processing is 
completed by step ST508-6. That is, unless it is an information lack block in both a left-central 
pair and a central-right pair, it is possible to acquire parallax information, i.e., distance 
information. 

[0094]As a similarity calculation means used in points-of-comparison search in stereo- 
correspondences search, accumulation difference absolute value S SAD (dx, dy) of the following 

(formula 7) is used. 
[0095] 
[Equation 4] 

s MD (4.<y = ^ ( * 7) 

[0096]Next, in step ST509 of drawing 14 , the highest rung surface area extraction means 13 
extracts the field of an objective highest rung side using the depth map generated in the with 
processing corresponding to the above-mentioned stereo block. 

[0097]It is processed like embodiment 2. after step ST510. In step ST510, a two-dimensional 
reference pattern is automatically generated by the two-dimensional reference pattern creating 
means 17 using the size data of the recognition objects stored in the object size database 16. In 
step ST51 1, the picture from which the above-mentioned highest rung surface area was 
extracted is divided into two, a highest rung side and the other field, and is binary-ized, and one 
of the highest rung object candidates is extracted by the highest rung object candidate 
extraction means 14. In step ST512, the precise position of candidate objects is measured and 



detected by the object posWn detecting means 18 [ near / which^Ws extracted / one object 
candidate's position ] using the above-mentioned two-dimensional reference pattern and the 
above-mentioned shade original image information. Thus, the two-dimensional position of the 
determined candidate objects is unified with the depth map information on the high resolution 
compounded [ above-mentioned ] by the information integration means 19, and is eventually 
outputted as objective three-dimensional information by it. In step ST513, by processing of step 
ST511 and ST512. If the object which will be that processing is ended by step ST514 and will not 
be recognized if it is judged that it carried out by making a judgment of whether all the objects 
have been recognized and no is judged to still exist, the processing which returns to step ST51 1 
and ST512 and extracts an object candidate will be repeated. 

[0098]As explained above, in this embodiment 5. 2 sets of stereo images are generated using 
three cameras of the image input means 51, to an information lack block produced with a stereo 
image of one group, by parallax information by a stereo image picture of other groups, 
information is complemented and lack of information is prevented. 

[0099]In this embodiment 5., have arranged so that it may have an optic axis which exists in the 
same flat surface in parallel with regular intervals as spatial arrangement of three image input 
means, but. Even if arrange a camera optical axis of the left, the right, or its both so that a 
center camera optic axis may be crossed, or a camera interval is arranged so that it may not be 
regular intervals, or it arranges so that three optic axes may not necessarily be found on the 
same flat surface, an effect which a lack block complements similarly is acquired. 
[01 00] Although normalization cross correlation was used as a similar formula of high reliability in 
embodiment 5., using an accumulation difference absolute value as a high-speed similarity 
calculation equation, For example, the maximum of an absolute value of a difference of each pixel 
value during a block may be used as high-speed similarity, or total of a square of a difference 
may be used as high reliability similarity. 

[0101]A flow chart which shows drawing 1 7 and a flow of operation for a block diagram showing 
composition of embodiment 6. embodiment 6. is shown in drawing 18 . In drawing 1 7 f 11-13, 15- 
17, 19, and 21 have the same function as embodiment 1., and explanation is omitted. As for 64, in 
a figure, a hypothetical validation means and 69 are object position detecting means an object 
candidate combination hypothesis generating means and 65. 

[0102]By step ST601, when a device is started, with two cameras of the image input means 11, a 
picture of an object body is inputted into the depth map creating means 12, and is stored 
individually. A thing of the same specification between which two cameras do not share an optic 
axis is used. By step ST602, stereo matching of the stereo image of the two above-mentioned 
sheets is carried out by the depth map creating means 12, and a depth map is generated from 
the azimuth difference. 

[0103]By step ST603, a shade original image picturized by the image input means 11 is stored in 
a shade original image storing means. A shade original image of an object made into a recognition 
object of this embodiment 6. is shown in drawing 1 9 (a). An object is a box-like object of a 
carton box etc., and they are loaded into several steps. A depth map is extracted from a picture 
of an upper surface portion of a highest rung object by ** et al. and the highest rung surface 
area extraction means 13 as a field by step ST604. Drawing 19 (b) is the extracted highest rung 
object area. Fields other than the highest rung are also shown like a figure. 
[0104]In step ST605, a reference pattern which expressed an objective two-dimensional image 
pattern by the two-dimensional reference pattern creating means 17 is automatically generated 
using data stored in the object size database 16 which stored size data of a case shape object. 
A mimetic diagram of the reference pattern is shown in drawing 1 9 (c). 

[0105]Explanation of the following operations is a portion used as essence of this embodiment 6. 
In step ST607, one combination hypothesis of an object candidate is generated from highest rung 
surface area and a two-dimensional reference pattern which were extracted [ above- 
mentioned ] by the thing candidate combination hypothesis generating means 64. As a 
hypothesis was shown in drawing 19 (c), it calls this hypothesis "the hypothesis 1 " in this 
embodiment 6. As opposed to what expressed a highest rung object area [ like drawing 1 9 (b) ] 
whose hypothesis is by a picture, A reference pattern of a recognition object thing is processed 



by technique of pattern m^^Png, for example, template matching, it is obtained by guessing 
combination of a two-dimensional reference pattern which forms highest rung surface area like 
drawing 1 9 (b). An object two-dimensional position is simultaneously detected like drawing 1 9 (d) 
by the object position detecting means 69. Comparison with a shade original image and the 
above-mentioned two-dimensional reference pattern which were stored [ above-mentioned ] 
performs object position detection. It is template-matching **** between edge images detected 
from the above-mentioned shade image using information on a contour part of a two-dimensional 
reference pattern. In a pattern searching field in template matching processing since an objective 
coarse position is known in a stage of hypothetical generation in that case, only the above- 
mentioned neighborhood of a position is. 

[0106]It is verified in step ST608 whether the above-mentioned hypothesis is appropriate. It is 
calculated whether the hypothetical validation means 65 generates a hypothetical picture like 
drawing 1 9 ( d), and highest rung surface area like drawing 1 9 (b) may be rationally generated by 
combination of six objects to the object candidates 1-6. That is, a hypothetical picture 
generated by the six above-mentioned object candidates is compared with a highest rung side 
image, and it operates so that it may judge with it being the hypothesis which computed area of 
a field used as the difference, and was mistaken, so that the above-mentioned area was large. In 
step ST608, the one validity index is given to one hypothesis generated by step ST606 in this 
way. A reciprocal of the above-mentioned area serves as a validity index. 

[0107]By step ST609, repeatedly, by step ST610, all hypotheses are generated and a hypothesis 
with the highest validity is chosen in them until it generates all hypotheses that can consider 
processings from step ST606 to ST608. That is, said validity index about each hypothesis is 
compared, and a hypothesis with the highest index is chosen. Drawing 1 9 (e) and (f) is the 
respectively -different hypothesis 2 and the hypothesis 3. Since the hypothesis 2 has the highest 
validity index in this case so that clearly from a figure, this will be chosen in step ST610 as best 
hypothesis 

[0108]In step ST61 1, two-dimensional position information equivalent to the above-mentioned 
best hypothesis and said depth map are unified by the information integration means 19, it is 
outputted.from a device as a recognition result by step ST612, and processing is ended by it. 
[01 09] Although stereo ** with two cameras was used for this embodiment 6. as a depth map 
creating means, A depth map creating means by stereo ** which used together floodlighting of 
characteristic floodlighting patterns, such as stereo ** with three or more cameras and a random 
dot, or a spatial code-ized method explained as conventional technology may be sufficient. Since 
it has the feature that this Embodiment 6 verifies a hypothesis of a recognition result obtained 
from a depth map, and obtains a result which will seemingly be reasonable, what kind of thing 
may be sufficient as a generation method of a depth map? 

[01 10] Although a method of calculating a validity index based on a difference of a hypothetical 
picture and a actual picture was used for this embodiment 6. as a method of verifying 
hypothetical validity, For example, same effect can be acquired, even if it uses an index which is 
made high [ validity ] so that total to all the candidate objects of similarity of template matching 
calculated when acquiring the above-mentioned hypothesis is large. 

[01 1 1] Although profiling information of an object obtained from a reference pattern and an edge 
image generated from a shade original image were processed with the template-matching 
technique as a detecting method of an object position in this embodiment 6., Same effect can be 
acquired even if it uses the positioning techniques, such as template matching of a binary format 
image, for this. 

[01 12] Although this embodiment 6. explained a process flow which performs an object 
candidate's generation and verification of a combination hypothesis one by one, many 
hypotheses are generated at once and stored, and those validation is performed at once and it 
may be made to choose what has the highest validity. 

[01 13] Although embodiment 6. explained that all the hypotheses were generated, since a 
hypothesis is acquired as an object candidates combination, it is treated as an objective 
combinatorial optimization problem, and same effect is acquired even if it calculates an 
approximate solution. 



[01 14]A flow chart which srSws drawing 20 and a flow of operation^ff a block diagram showing 
composition of embodiment 7. embodiment 7. is shown in drawing 21 . In drawing 20 , 11-13, 15-19 
have the same function as embodiment 6., and explanation is omitted. As for 71, an object 
arrangement judging means and 73 are warning generation means an object arrangement 
reference database and 72. 

[01 1 5]This embodiment 7. is constituted so that warning may be generated, when object 
arrangement is accidentally arranged by composition of embodiment 6. Therefore, Steps ST701- 
ST71 1 of a flow of drawing 21 are the same as those [ 601-61 1 ] of drawing 1 8 . 
[01 16]When a device is started by step ST701, by the image input means 1 1, a picture of an 
object body is inputted into a depth map creating means, and is stored individually. By step 
ST702, stereo matching of the picture of the two above-mentioned sheets is carried out by the 
depth map creating means 12, and a depth map is generated from the azimuth difference. It may 
be the stereo vision which used together a pattern floodlight as the necessity that this 
processing is not necessarily simple stereo matching not had, for example, shown in embodiment 
2. 

[011 7]In step ST703, a shade original image of a recognition object thing is inputted by the image 
input means 1 1, and it is stored in the shade originaUmage storing means 15. Highest rung 
surface area is extracted by the highest rung surface area extraction hand 1 3 by step ST704. In 
step ST705, a reference pattern which expressed an objective two-dimensional image pattern by 
the two-dimensional reference pattern creating means 17 using the object size database 16 
which stored size data of a case shape object is generated automatically. In step ST706, one 
combination hypothesis of an object candidate is generated by the object candidate combination 
hypothesis generating means 64 from highest rung surface area and a reference pattern which 
were extracted [ above-mentioned ]. As [ showed / a hypothesis / that embodiment 6. 
explained / same drawing 1 9 (d) ] As opposed to what expressed a highest rung object area [ like 
drawing 1 9 (b) ] whose hypothesis is by a picture in this embodiment 7., A reference pattern of a 
recognition object thing was processed by technique of pattern matching, for example, template 
matching, and it has obtained by guessing combination of a two-dimensional reference pattern 
which forms highest rung surface area like drawing 19 (b). In step ST707, a two-dimensional 
position of each candidate objects contained in the above-mentioned hypothesis by the object 
position detecting means 69 like drawing 19 (d) is detected. Object position detection is detected 
by template matching between a shade original image stored [ above-mentioned ] and an edge 
image detected from a shade image using information on a contour part of the above-mentioned 
two-dimensional reference pattern. 

[01 18]In step ST708, a hypothetical picture generated by two or more above-mentioned object 
candidates is compared with a highest rung side image, and it judges with a possibility of being 
the hypothesis which computed area of a field used as the difference, and was mistaken, so that 
it was large being high. In Step 709, repeatedly, at Step 710, all hypotheses are generated and a 
hypothesis with the highest validity is chosen in them until it generates all hypotheses that can 
consider processing of step STs 706-708. That is, said validity index about each hypothesis is 
compared, and a hypothesis with the highest index is chosen. 

[01 1 9]ln step ST711, two-dimensional position information and the above-mentioned depth map 
which are equivalent to the best hypothesis by the above-mentioned hypothesis by the 
information integration means 19 are unified. At this time, it means that an image processing 
device in this embodiment 7. had known objective arrangement and a three-dimensional position 
of each object, and it is stored in an inside of a device. In Step 712, it is judged whether a 
recognition result stored [ above-mentioned ] has agreed compared with right array data 
prepared beforehand by the object arrangement judging means 72. Right array data is the 
arrangement pattern decided with an object stored in the object arrangement reference database 
71 to be recognized, for example, — in a physical distribution factory where this device to 
embodiment 7. twist is used — a carton box as recognition objects — that shape and size — 
beforehand — the right — " — how to stack a box to a palette top which stacks and is. called 
pattern" is decided on. 

[0120]Objective arrangement which should be made such a standard is described by the above- 



mentioned object arrangen^Jr reference database. When [ from wNWa result recognized in 
step ST712 serves as a standard ] stacking and not having agreed with a pattern, in step ST713, 
it tells that generate warning to a device user or an administrator of a host system, and an 
object is not correctly stacked by the warning generation means 73. Warning is **** made a 
sound according [ this embodiment 7. ] to a buzzer by character representation to a display 
device for a display connected to a device. When judged with a recognition result being a right 
pattern in step ST712, gripping operation of an object by a robot will be performed by a final 
object recognition result's being outputted by the information integration means 19, for example, 
transmitting data to a robot. As recognition operation, operation is ended by step ST715. 
[0121]In this embodiment 7., when it not only recognizes an object in this way, but it judges 
whether it is the arrangement expected by comparing that arrangement pattern with criterion 
data and the above-mentioned recognition result differs from criterion data further, it has the 
function to generate warning. There is an advantage that he can stack, and a worker can notice 
a work error by this, or intense collapse of cargo piles under transportation can be detected. 
[0122]A method of verifying stereo ** with two cameras based on a difference of a hypothetical 
picture and a actual picture as the method of hypothetical validation as a depth map creating 
means and the template-matching technique which used objective profiling information as a 
detecting method of an object position are used, respectively. However, even if it realizes these 
partial processing means processing means with other techniques, it cannot be overemphasized 
that same effect is done so. For example, stereo ** which uses together a pattern explained by 
embodiment 2. as a depth map creating means, The template-matching method by a shade image 
pattern and normalization cross correlation which prepared beforehand each object contained in 
a hypothesis by making into an object position detecting method a method which is judged that 
validity is high, so that total of similarity [ a shade reference pattern / object / each ] is high as 
the hypothetical validation method, It may adopt, respectively. 

[0123]When it judged that a recognition result does not suit as compared with an object 
arrangement reference database stored beforehand, an example which generates warning was 
explained, but the contents of warning are changed and it may be made to make a device user 
and a worker know according to a similar degree with criterion data. For example, it displays 
"Rightness of a way which was judged as a result of automatic recognition and to stack is the 
level 8" etc. on a control display for indication. As a result of having recognized furthermore, 
when a load collapse state of a cargo is judged that are dramatically remarkable and it is not 
appropriate to continue work as it is, it not only may emit the above-mentioned warning, but it 
may require a stop of a system of an administrative computer of a higher rank, or this device 
may be made to carry out a direct system stop. 

[01 24] Although a character representation by buzzer and a display for indication was adopted as 
a warning means, a method of generating human being's compounded voice may be used as a 
means to send warning to human being. 

[0125]A flow chart which shows drawing 22 and a flow of operation for a block diagram showing 
composition of embodiment 8. embodiment 8. is shown in drawing 23 . In drawing 22 , 11-15, 17, 
and 19 have the same function as embodiment 1., and explanation is omitted. An artificial 
reference pattern creating means in which 81 generates an artificial two-dimensional reference 
pattern based on objective size data in a figure, An actual image reference pattern storing means 
and 88 are object position detecting means an actual image reference pattern logging means by 
which 82 extracts a reference pattern of an actual image corresponding to a size of recognition 
objects from a shade original image, and 83. 

[01 26]If a device is started by step ST801, a picture of recognition objects will be inputted into 
the depth map creating means 12 by the image input means 11. In step ST802, a depth map is 
generated by the depth map creating means 12 using an inputted picture. Although what kind of 
thing may be used as a depth map creating means, suppose that stereo vision with two cameras 
is used in this embodiment 8. Therefore, an image input means uses two television cameras. 
These two cameras have the same optical specification, and they are arranged so that an optic 
axis may not be shared. Usually, it arranges so that a camera optical axis may become almost 
parallel like human beings eyes. In step ST803, one camera of the described image input means 



11 is used, a shade original iiWfe is picturized, and it stores in the sWne original image storing 
means 1 5. Even if a shade image picturized to the above-mentioned depth map generate time is 
used for this original image as it is, it does not interfere. 

[0127]In step ST804, the highest rung surface area extraction means 1 3 extracts objective 
highest rung surface area using a depth map. A field of an extracted highest rung object is the 
same as that of what is drawn on drawing 3 (b) in ** type. That is, a highest rung field is 
expressed as a picture of a binary "0" So that "1" and the other field may be said. In this 
embodiment 8., it supposes that it is a recognition object a box-like object like a carton box, and 
the same object piled on the ground in heaps is picturized by an image input means installed 
downward in a ceiling, i.e., a television camera. In step ST805, an artificial two-dimensional 
reference pattern is generated by the artificial reference pattern creating means 81 based on 
size data of a box-like object used as a recognition object beforehand stored in the object size 
database 17. Although this is the same as that of a two-dimensional reference pattern in 
explanation of embodiment 1., in order that this may emphasize that it is the pattern generated 
artificially and automatically, especially by this embodiment 8., it calls in this way. This reference 
pattern expresses only a contour part of an object as shown in drawing 3 (bX 
[01 28]In step ST806, one candidate of an object considered to exist in the highest rung by the 
highest rung object candidate extraction means 14 is extracted from a binary format image 
expressing extracted highest rung surface area. Here, a candidate is extracted by detecting a 
peripheral area at which it crosses right-angled from an object being visible to a rectangular 
pattern on a picture to a highest rung object area expressed with a binary. A candidate s 
extracted mimetic diagram is the same as that of drawing 3 (d) in explanation of embodiment 1 . 
In step ST807, the above-mentioned object candidate is positioned by using the template- 
matching method by the object position detecting means 14. The above-mentioned artificial 
reference pattern is used as a template. In template matching, an edge image obtained as a 
result of carrying out the edge detection process of the original image stored in the above- 
mentioned shade original image storing means 15 into the object position detecting means 88 as 
a picture used as an object which looks for a template is used. In this template matching, since a 
rough position is already detected in a stage of the above-mentioned candidate extraction, just 
processing in which only that very neighborhood is searched from a candidate detection position 
is enough as matching here. A situation of positioning is as drawing 3 . 

[0129]As a result of positioning processing, although similarity with a template is obtained with 
position information, this is data expressing similarity to an artificial reference pattern generated 
beforehand. An object detected, so that similarity was high resembles a right box assumed 
beforehand, and when similarity is low, it can be said that a possibility that positioning has gone 
wrong is high. So, in step ST808, it **** that it is the reliability of object detection of obtained 
similarity data, and this judges whether it is larger than a reliability threshold beforehand stored 
in this device. Reliability of an object obtained as a result of positioning judges that an object 
mistaken when smaller than a reliability threshold was detected, and repeats processing from 
step ST806, another highest rung object candidate is extracted again, and a detecting position 
using an artificial pattern is performed. When obtained reliability is larger than a threshold, it will 
progress to the following step ST809. 

[0130]In step ST809, by the actual image reference pattern logging means 82, a reference 
pattern of an actual image corresponding to a size of recognition objects in an object position 
detected eventually is extracted, and it is stored actual image reference pattern storing means 
83. At this time, an actual image means a shade original image stored in the shade original image 
storing means 15, and a logging position is a position of an object detected [ above-mentioned ]. 
A logging field is a rectangle and the size is changed into a size on a picture with distance of a 
camera and an object which were able to obtain dressed-size data of the above-mentioned 
object from the above-mentioned depth map. That is, a rectangular image field as a shade image 
corresponding to one object to recognize is started. 

[0131]In step ST810, an object after the 2nd is detected from a picture by the object position 
detecting means 88. Here, different techniques from the time of said first object detection are 
used. A pattern in which even an object as a shade actual image stored in the above-mentioned 



actual image reference patte^^ioring means 83 corresponds is mac^Pfto a template, and the 
template-matching method for detecting a pattern position which resembles a template most out 
of an original image stored in the shade original image storing means 83 is applied. 
[01 32]It is judged whether it is equivalent to all the objects required as liking to recognize a 
detected object beforehand in step ST81 1, If all the objects are recognized, after calculating a 
three-dimensional position of each object by unifying the above-mentioned detection object 
position and depth map information and transmitting the result to an upper rank host computer 
or a robot by the information integration means 19, processing is ended by step ST812. 
Processing is repeated from step ST810 until objective recognition finishes. That is, although an 
object of eye one is recognized using a depth map etc., an object after the 2nd is detected by 
template matching based on an actual image pattern as a shade image obtained at the time of 
the 1 st recognition. 

[01 33] Although an example which adopted general stereo vision as a depth map creating means 
explained in embodiment 8., An effect that depth map generation by stereo ** using random dot 
pattern floodlighting which was explained by embodiment 2., and a spatial code-ized method 
explained by a Prior art is also the same is acquired. 

[0134]A flow chart which shows drawing 24 and a flow of operation for a block diagram showing 
composition of embodiment 9. embodiment 9. is shown in drawing 25 . in drawing 24 — 11 — an 
image input means and 91 — as for a depth map creating means and 92a, the first depth map 
storing means and 92b of a depth map comparison means and 94 are [ a position-correction- 
quantity calculating means and 96 ] object transportation devices an initial gripping position 
calculating means and 95 the second depth map storing means and 93. 

[0135]Objective shape is a polyhedron like a carton box so that explanation may be easy to be 
understood, and it is explained supposing a thing of identical shape and an identical size. This 
embodiment ^, can use composition of this embodiment 9,, even if shape of recognition objects 
does not necessarily need to be polyhedral form and objects are saccate objects, such as a 
cement bag. 

[01 36]If a device is started by step ST901, a picture of an object of a recognition object will be 
inputted into the depth map creating means 91 by the image input means 1 1. In step ST902, 
using an inputted picture, a depth map is generated by the depth map creating means 91, the 
first depth map is generated in step ST903, and it is stored in the first depth map storing means 
92a. Although what kind of thing may be used as a creating means of a depth map, there are a 
spatial code-ized method and a method of generating from stereo vision, for example. 
[0137] Drawing 26 explains a depth map. An original image picturized by the image input means 1 1 
in the state where a box-like object when initial-state, i.e., step ST, 901 was performed was 
tiered is expressed by drawing 26 (a) in ** type. Drawing 26 (b) expresses a depth map stored in 
the first depth map storing means 92a in ** type. A depth map expresses distance from a 
camera of an image input means to an object in picture, expresses it with such a bright color 
that distance from a camera is near, and is expressed in such a dark color tone that distance 
from a camera becomes large. 

[01 38]In the following step ST904, an initial gripping position is calculated by the initial gripping 
position calculating means 94 from a depth map. An initial gripping position is a position grasped 
in order to move an object by the object transportation devices 96, such as a robot. Let a 
position which processed the first depth map of the above and has recognized a corner part 
from a field currently displayed in a bright color in an object area (b), i.e., drawing 26 , which are 
located in the highest rung and to which fixed offset was applied from a corner position for 
determining an initial gripping position be an initial gripping position. In this case, it means that it 
was set up on the object A. As for the direction of an arrow, an intersection of a grip direction, 
an arrow, and a straight line expresses a gripping position on drawing 26 (b). However, even if a 
gripping position which did not necessarily determine a gripping position that the object A should 
be grasped intentionally here and for which it asked by a simple method from a depth map exists 
on objects other than the object A in this case, If an initial gripping position was set up by 
something on a same thing object as a result, in transfer operation of a cargo, it will not be a 
problem at all. 



[0139]Ir> Step 905, an object^Rnge means slack robot grasps an iniWr gripping position, and an 
object is temporarily evacuated out of a view of an image input means. Drawing 26 (c) shows a 
situation after object evacuation. A robot adsorbs a gripping position on the object A by an 
adsorption hand, and objective saving operation is performed by moving a hand to a retreating 
position decided beforehand. However, a robot is evacuated by making a hand stand it still, with 
the object A grasped here. A hand is the position which understands that a position which is 
making the object stand it still is out of a view of the described image input means 1 1 clearly, 
and a retreating position decided beforehand is a position set up such. 
[0140]A depth map of a cargo is again generated by the depth map creating means 91 after 
object evacuation, and it stores in the second depth map storing means 92b at Step 907 step 
ST906. Drawing 26 (d) expresses the second depth map of this embodiment 9. in ** type. In this 
figure, a field which is equivalent to the evacuated object A from a highest rung object area has 
applied. 

[0141]In step ST908, the first depth map and second depth map are compared by the depth map 
comparison means 93, and position correction quantity is further calculated by the position- 
correction-quantity calculating means 95 based on the result. In this embodiment 9., difference 
simple as comparison of a depth map is performed. Drawing 26 (e) is detected from the first 
depth map by lengthening the second depth map. The field B in which this figure is equivalent to 
the object A evacuated temporarily [ drawing 26 (c) ] remains as a difference of two depth maps. 
The number of objects grasped and evacuated by a robot is one, and, naturally only a portion 
which is equivalent to an evacuated object in a depth map before and after saving operation 
exists as a difference. Since it turns out that the field B is equivalent to an object piece as a 
difference result of a depth map, the shape and centroid position are easily calculable. After 
binary-izing a difference image clearly on a picture, for example as a background and the 
technique of calculating the center of gravity of a field, shape, and direction which were 
separated and performing labeling for every field, a technique generally used from the former by 
which each label attachment was carried out, and which calculates the center of gravity and 
moment maximum directions for every field is applicable. 

[01 42]Although drawing 26 (f) is an enlarged drawing of an evacuated object, a gripping position 
which was obtained from a depth map difference result and which was calculated newly can be 
found besides an initial gripping position, and it is taken as a gripping position which calculated 
the above-mentioned centroid position newly. Position correction quantity is calculated as a 
difference of these two gripping positions. 

[01 43] Although a robot has still grasped an initial gripping position at this time, a difference of a 
right gripping position, i.e., an objective centroid position, is already calculated. Therefore, a hand 
will know which objective position is grasped by sending the above-mentioned position- 
correction-quantity data to a robot about the object A which evacuated a robot in step ST909. 
Therefore, in the case of moving operation by a continuing robot, the robot can perform moving 
operation in consideration of the above-mentioned correction amount. This is equivalent to 
having already known correctly for a robot, in moving work of a cargo, when an object was 
grasped first, objective centroid position, i.e., position which should be grasped, It means having 
realized operation same with a robot grasping an objective exact gripping position and performing 
moving work. 

[0144]Supposing it judges whether all the objects have been recognized and recognizes by step 
ST910, it will progress to step ST91 1 and processing will be finished. When processing has not 
been ended, processing is repeated from step ST902 until processing is completed. 
[0145]As mentioned above, gestalt 9. evacuates to this operation based on an initial gripping 
position recognized from the first depth map, and evacuates only one object out of a picture, 
When it becomes a difference with the second depth map generated after that, an exact gripping 
position of an object under present evacuation is calculated based on shape and position 
information of an appearing object and a robot moves an object to the target position, a 
difference of an initial gripping position and an exact gripping position is amended. 
[01 46] Although it was considered as a position to which fixed offset was applied from corner 
points and a gripping position was determined as the technique of asking for an initial gripping 



position.in this embodiment J^fcsed on a corner part of the first dep^^nap to a highest rung 
object area, For example, it may consider that a highest rung field in a depth map and the other 
field are binary format images, and a gripping position may be determined using the binary 
template-matching method. 

[01 47] Although operation to which it is made to move grasping an initial gripping position by a 
robot hand, and grasping an object by a hand out of a picture view as objective temporary 
evacuation was performed in this embodiment 9., an object may once be taken down to a 
predetermined place. If an initial gripping position can be grasped when grasping an object by a 
hand again after taking down, the same operation as this embodiment 9. can be considered. 
[01 48] Although it was considered as operation which makes a robot hand which grasped an 
object stand it still by a position as saving operation in this embodiment 9., By performing 
processings from step ST906 in drawing 25 t o ST908 at high speed, it can also serve as saving 
operation with operation which moves a hand continuously. That is, it takes out out of an 
objective picture view, while moving a robot hand near [ purpose slack transfer place ] moving 
work, position-correction-quantity calculation is completed, and when a robot sets an object at a 
predetermined place for a transfer, even if it performs operation which considered position 
correction quantity, it has the same effect. 
[0149] 

[Effect of the Invention]The depth map creating means in which the image processing device 
concerning Claim 1 of this invention generates the depth map of two or more objects, A highest 
rung surface area extraction means to extract objective highest rung surface area from a depth 
map, A highest rung object candidate extraction means to dissociate separately and to extract 
an object from highest rung surface area, The two-dimensional reference pattern creating means 
which generates the two-dimensional reference pattern on an objective two-dimensional picture 
based on the size data of recognition objects, The shade original image storing means which 
stores the shade original image inputted from the camera, The object position detecting means 
which detects an objective position using the information on a two-dimensional reference 
pattern and a shade original image about the highest rung object candidate extracted individually, 
By having had the information integration means which unifies the detection result of the object 
position obtained by each means, and the distance information of each object obtained by the 
depth map creating means, It may be small as a device, since the image input means of 
recognition objects and a depth map creating means are the things of coarse accuracy and end, 
and cheap, and a floodlighting device may also be simple and its reliability improves. 
[0150]The depth map creating means in which the object transfer equipment concerning Claim 2 
of this invention generates the depth map of two or more objects, A highest rung surface area 
extraction means to extract objective highest rung surface area from a depth map, A highest 
rung object candidate extraction means to dissociate separately and to extract an object from 
highest rung surface area, The two-dimensional reference pattern creating means which 
generates the two-dimensional reference pattern on an objective two-dimensional picture based 
on the size data of recognition objects, The shade original image storing means which stores the 
shade original image inputted from the camera, The object position detecting means which 
detects an objective position using the information on a two-dimensional reference pattern and a 
shade original image about the highest rung object candidate extracted individually, By having 
combined with the object transfer equipment the image processing device provided with the 
information integration means which unifies the detection result of the object position obtained 
by each means, and the distance information of each object obtained by the depth map creating 
means, and having carried out it in this way, An object transfer equipment it may be small as a 
device, since the image input means of recognition objects and a depth map creating means are 
the things of coarse accuracy and end as an object transfer equipment, and cheap, simple a 
floodlighting device and reliable is obtained. 

[0151]The random texture light projection means which floodlights a texture pattern random 
[ image processing device / concerning Claim 3 of this invention ] in a depth map creating 
means, Since it constituted from a with means corresponding to a stereo image block to carry 
out with correspondence between two pictures which the first image input means and the 



second image input means wwn input a stereo image, and the first Urthe second image input 
means picturized, Since a random dot pattern is floodlighted to recognition objects, even if it has 
stuck the object of the solid color which does not have a pattern in the surface, or the label 
which light reflects in the surface, The distance data in that of a surface Gentlemen value can 
be obtained correctly, the composition of a floodlight is also simple, it is small and cheap, and 
reliability becomes high well. 

[0152]The random texture light projection means which floodlights a texture pattern random 
[ transfer equipment / concerning Claim 4 of this invention / object ] in a depth map creating 
means, The first image input means and second image input means that input a stereo image, By 
having combined with the object transfer means the image processing device which comprised a 
with means corresponding to a stereo image block to carry out with correspondence between 
two pictures which the first and the second image input means picturized, and having carried out 
it in this way, Since a random dot pattern is floodlighted to recognition objects, even if it has 
stuck the object of the solid color which does not have a pattern in the surface, or the label 
which light reflects in the surface, Surface each position is acquired correctly, the objective 
detection time as an object transfer equipment is short, an objective position is detected 
correctly, a transfer of an object can be performed correctly quickly, the composition of a 
floodlight will also become small and cheap and its reliability will improve. 

[0153]The low resolution depth map creating means in which, as for the image processing device 
concerning Claim 5 of this invention, a depth map creating means generates a depth map with 
coarse resolution, A level difference region extraction means to extract an objective level 
difference region part from a low resolution depth map, Since it should comprise a high 
resolution depth map creating means which generates the depth map of high resolution to a level 
difference region, and a depth map synthesizing means which compounds two depth maps from 
which the resolution of a low resolution depth map and a high resolution depth map differs, There 
is an effect which the depth map of high resolution is generated and can also make an object 
candidate's extraction precision high by short calculation time by few image memories. 
[0154]The low resolution depth map creating means in which, as for the object transfer 
equipment concerning Claim 6 of this invention, a depth map creating means generates a depth 
map with coarse resolution, A level difference region extraction means to extract an objective 
level difference region part from a low resolution depth map, The high resolution depth map 
creating means which generates the depth map of high resolution to a level difference region, 
Combine with an object transfer means the image processing device which comprised a depth 
map synthesizing means which compounds two depth maps from which the resolution of a low 
resolution depth map and a high resolution depth map differs, and by short calculation time. The 
depth map of high resolution is obtained, an object candidates extraction time is short, 
extraction precision is high, an objective position is detected correctly, and a transfer of an 
object can be performed correctly quickly. 

[0155]A high-speed similarity calculation means by which, as for the image processing device 
concerning Claim 7 of this invention, the with means corresponding to a block searches for a 
correspondence image block on either side at high speed, It is what comprised a high reliability 
similarity calculation means to calculate similarity to high reliability about the pair of the block 
which is search results, and a corresponding block reliability judgment means will judge that have 
no corresponding block if high reliability similarity is below a fixed threshold, Since the depth map 
was generated, a depth map highly precise at high speed is obtained, the reliability of picture 
matching becomes high, and the reliability of the whole device becomes high. 
[0156]A high-speed similarity calculation means by which, as for the object transfer equipment 
concerning Claim 8 of this invention, the with means corresponding to a block searches for a 
correspondence image block on either side at high speed, A high reliability similarity calculation 
means to calculate similarity to high reliability about the pair of the block which is search results, 
The image processing device which comprised a corresponding block reliability judgment means 
judge that has no corresponding block when high reliability similarity was below the fixed 
threshold, Since it combines with an object transfer means and the depth map highly precise at 
high speed was obtained, an object candidate's extraction time is short, extraction precision is 



high, thp reliability of picturd^ptching becomes high, an objective p^pon is detected correctly, 
and a transfer of an object can be performed correctly quickly. 

[0157]The image processing device concerning Claim 9 of this invention has three or more image 
input means, The with means corresponding to a block chooses two or more kinds of picture 
pairs which chose the inner 2 ** picture of each picture acquired from three or more image input 
means, Since the combination of a stereo image is changed and it is complemented even if the 
lack block of the pair of a stereo image arises, since with [ corresponding to a block ] is 
performed, each search results with correspondence are unified and the depth map was 
generated, it is effective in lack of information being prevented and a high-precision depth map 
being obtained. 

[0158]The object transfer equipment concerning Claim 10 of this invention, Have three or more 
image input means, and the with means corresponding to a block chooses two or more kinds of 
picture pairs which chose the inner 2 ** picture of each picture acquired from the three or more 
above-mentioned image input means, Since the image processing device which performs with 
[ corresponding to a block ], unifies each search results with correspondence, and generates a 
depth map should be combined with the object transfer means, an objective position is detected 
with sufficient accuracy and a transfer can be performed correctly. 
[0159]The image processing device concerning Claim 11 of this invention, The depth map 
creating means which generates the depth map of two or more loaded objects, and a highest 
rung surface area extraction means to extract the highest rung surface area of the object 
located in the highest rung from a depth map, The object candidate combination hypothesis 
generating means which carries out two or more listing generation of an object candidate's 
combination as a hypothesis from the output of a highest rung surface area extraction means, 
The object size database which stores the size data of recognition objects, a two-dimensional 
reference pattern, and a hypothetical validation means to verify the validity of the object 
candidate combination hypothesis which the above-mentioned hypothesis generating means 
generated using the information included in a shade original image, It should have the information 
integration means which recognizes based on a hypothesis with the highest evaluation value 
among two, or. more hypotheses, and unifies this recognized picture and the distance information 
of each object obtained by the depth map creating means. Since the position of two or more 
candidate objects is detected from the arrangement hypothesis of an object body to the highest 
rung surface area extracted from the depth map, 1 time may be sufficient as the signal 
transduction to a transfer means, and hour corresponding is short, and when beforehand based 
on a texture **** loading method, loading by mistake can also be detected and it can also be 
determined further whether a highest rung object grasps either. 

[0160]The object transfer equipment concerning Claim 12 of this invention, The depth map 
creating means which generates the depth map of two or more loaded objects, and a highest 
rung surface area extraction means to extract the highest rung surface area of the object 
located in the highest rung from a depth map, The object candidate combination hypothesis 
generating means which carries out two or more listing generation of an object candidate's 
combination as a hypothesis from the output of a highest rung surface area extraction means, 
The object size database which stores the size data of recognition objects, a two-dimensional 
reference pattern, and a hypothetical validation means to verify the validity of the object 
candidate combination hypothesis which the above-mentioned hypothesis generating means 
generated using the information included in a shade original image, Recognize based on a 
hypothesis with the highest evaluation value among two or more hypotheses, and it has an 
information integration means which unifies this recognized picture and the distance information 
of each object obtained by the depth map creating means, Since the position of two or more 
candidate objects is detected from the arrangement hypothesis of an object body to the highest 
rung surface area which combined with the image processing device and object transfer means 
which output the three dimensional position information on each object body, and was extracted 
from the depth map, 1 time may be sufficient as the signal transduction to a transfer means, its 
hour corresponding is short, and it is also detectable to load by mistake, when beforehand based 
on a texture **** loading method, and further, It can also be determined whether a highest rung 



object grasps t either. 

[0161]The image processing device concerning Claim 13 of this invention, The object 
arrangement reference database which stores the data used as the standard of object 
arrangement The picture which a hypothetical validation means to verify the validity of the 
object candidate combination hypothesis which the hypothesis generating means generated has 
recognized, Since it shall have an object arrangement judging means which judges whether it is 
right arrangement as compared with criterion data, and a warning generation means which warns 
a worker of the result of a judgment when the recognized picture does not consistent with 
criterion data, When [ from which a recognition object stacks and a pattern serves as a 
standard ] stacking and not having become a pattern, it can warn a device user and the 
administrator of a host system of not being stacked correctly, and a dangerous state can be 
avoided. 

[0162]The object transfer equipment concerning Claim 14 of this invention, The object 
arrangement reference database which stores the data used as the standard of object 
arrangement, The picture which a hypothetical validation means to verify the validity of the 
object candidate combination hypothesis which the hypothesis generating means generated has 
recognized, The object arrangement judging means which judges whether it is right arrangement 
as compared with the above-mentioned criterion data, Since the image processing device and 
transfer means which have a warning generation means which warns a worker of the result of a 
judgment should be combined when the recognized picture did not consistent with criterion data, 
When [ from which a recognition object stacks and a pattern serves as a standard ] stacking and 
not having become a pattern, it can warn a device user and the administrator of a host system 
of not being stacked correctly, and a dangerous state can be avoided. 

[0163]The image processing device concerning Claim 15 of this invention, The position of the 
target object is detected from the object size database which stores the data used as the 
standard of object arrangement using the artificial reference pattern generated automatically, 
The actual image reference pattern logging means which starts the imaging range which is 
equivalent to said object body in a detection position, It has an actual image reference pattern 
storing means which stores the cut-down actual image reference pattern, It constitutes so that 
said actual image reference pattern may be used in subsequent recognition operation and it may 
operate, and the thing of small capacity may be sufficient as an image memory, image input time 
becomes short, and the object of the 2nd henceforth can detect it correctly earlier. 
[0164]The object transfer equipment concerning Claim 16 of this invention, The position of the 
target object is detected from the object size database which stores the data used as the 
standard of object arrangement using the artificial reference pattern generated automatically, 
The actual image reference pattern logging means which starts the imaging range which is 
equivalent to an object body in a detection position, It has an actual image reference pattern 
storing means which stores the cut-down actual image reference pattern, Since the image 
processing device and transfer means which were constituted so that an actual image reference 
pattern might be used in subsequent recognition operation and it might operate should be 
combined, in image input time, an object serves as short an object transfer equipment which can 
carry out a detection prickle transfer correctly. 

[0165]The image processing device concerning Claim 17 of this invention, The depth map 
creating means which generates the depth map of two or more tiered object bodies, Based on 
the information on the depth map stored in the first depth map storing means that stores the 
generated depth map, and this first depth map creating means, at the time of the initial bundle 
which calculates a position at the time of an objective bundle A position calculation means, The 
second depth map storing means that stores the depth map of the remaining cargo after 
evacuating an object to a position temporarily, A depth map comparison means to compare the 
depth map stored in the first depth map storing means with the depth map stored in the second 
depth map storing means, Since it shall have a position-correction-quantity detection means to 
determine the gripping position of the object evacuated based on the comparison result of this 
depth map comparison means, and to detect the difference of this gripping position and an initial 
gripping position as position correction value, Objective position recognition is possible only at a 



depth rpap, it can apply also^^he object which neither a shade nor^^edge image can use 
easily, and processing time also becomes short. 

[0166]The object transfer equipment concerning Claim 18 of this invention, The depth map 
creating means which measures the distance distribution from the image input means of two or 
more tiered object bodies, The first depth map storing means that stores the generated depth 
map, and the object transportation device which grasps an object and moves, At the time of the 
initial bundle which calculates a position based on the information on the above-mentioned depth 
map at the time of an objective bundle, a position calculation means, The second depth map 
storing means that stores the depth map of the remaining cargo after grasping an object in a 
gripping position and making it contrast with a position temporarily by an object transfer means, 
A depth map comparison means to compare the depth map stored in the first depth map storing 
means with the depth map stored in the second depth map storing means, The object transfer 
means which grasps and transfers the image processing device and object which have a 
position-correction-quantity detection means to determine the gripping position of the object 
evacuated using the comparison result of a depth map, and to detect a difference with an initial 
gripping position as position correction value is combined, and objective position recognition can 
be performed only in a depth map, It becomes an object transfer equipment which is correctly 
recognized also to the object which neither a shade nor an edge image can use easily, and can 
be safely transferred to an appropriate position. 
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[Brief Description of the Drawings] 

[Drawing 1]t his embodiment of the invention — it is a block diagram showing the composition of 
1. 

[Drawing 2] It is a flow chart which shows the flow of operation of embodiment 1. 
[Drawing 3] It is the picture generated in each stage in embodiment 1. 

^Drawing 4]t his embodiment of the invention — it is a block diagram showing the composition of 
2. 

[Drawing 5] It is a flow chart which shows the flow of operation of embodiment 2. 

[Drawing 6] It is an exposure explanatory view of a random dot pattern. 

[Drawing 7] It is an explanatory view of the block matching of a stereo image. 

[Drawing 8]t his embodiment of the invention — it is a block diagram showing the composition of 

3. 

[Drawing 9] It is a flow chart which shows the flow of operation of embodiment 3. 
"Drawing 10] It is an explanatory view of the situation of extracting a level difference region part 
from a low resolution depth map, accepting the level difference region part of a high resolution 
depth map, and performing the stereo correspondences of high resolution. 

[Drawing 1 1]t his embodiment of the invention — it is a block diagram showing the composition of 
4. 



[Drawing 12] It is a flow charl^Pich shows the flow of operation of e^BEdiment 4. 

[Drawing 13]t his embodiment of the invention — it is a block diagram showing the composition of 
5. 

[Drawing 14] It is a flow chart which shows the flow of operation of embodiment 5. 

[Drawing 15] It is a flow chart of the with operation corresponding to a stereo block. 

[Drawing 16] It is a figure showing a situation with the stereo correspondences of a stereo image 

typically. 

[Drawing 1 7]t his embodiment of the invention — it is a block diagram showing the composition of 
6. 

[Drawing 1 8] It is a flow chart which shows the flow of operation of embodiment 6. 

[Drawing 1 9] It is a figure showing each ****** of an operation situation which extracts an object 

candidate using an object candidate hypothesis. 

[Drawing 20]t his embodiment of the invention — it is a block diagram showing the composition of 
7. 

[Drawing 21] It is a flow chart which shows the flow of operation of embodiment 7. 

[Drawing 22]t his embodiment of the invention — it is a block diagram showing the composition of 

8. 

[Drawing 23] It is a flow chart which shows the flow of operation of embodiment 8. 

[Drawing 24]t his embodiment of the invention — it is a block diagram showing the composition of 

9. 

[Drawing 25] It is a flow chart which shows the flow of operation of embodiment 9. 

[Drawing 26] It is a figure showing each stage of the operation which amends an initial gripping 

position. 

[Drawing 27] It is an explanatory view showing the procedure of the conventional image 
processing device. 

[Drawing 28] It is a flow chart of operation of the processing shown in drawing 27 . 
[Drawing 29] It is a figure showing the principle of spatial-code-izing using pattern light. 
[Drawing 30] It is an explanatory view of the depth map instrumentation system of other 
conventional examples. 

[Drawing 31] It is an explanatory view of the stereo-correspondences searching device of 
another conventional Image Processing Division. 

[Drawing 32] It is a flow chart of another conventional Image Processing Division drawing 30 . 
[Description of Notations] 

1 1 An image input means and 12 A depth map creating means and 13 Highest rung surface area 
extraction means, 14 A highest rung object candidate extraction means and 15 A shade original 
image storing means and 16 Object size database, 17 A two-dimensional reference pattern 
creating means and 1 8 An object position detecting means and 1 9 Information integration means, 
20 A random texture pattern light projection means and 21 Image input means, 22 The with 
means corresponding to a stereo image block, and 30 A pattern floodlight and 31 The with means 
corresponding to a low resolution block, 32 A level difference region extraction means, the with 
means corresponding to 33 high-resolution block, and 34 Depth map synthesizing means, 41a 
The first image storing means and 41b The second image storing means and 42 High-speed 
similarity calculation means, 43 A high reliability similarity calculation means, 44 corresponding- 
block reliability judgment means, and 45 Depth map storing means, 51a The first image input 
means and 51b The second image input means and 51c The third image input means, 52 The 
with means corresponding to a stereo image block, and 64 Object candidate combination 
hypothesis generating means, 65 A hypothetical validation means and 69 [ A warning generation 
means and 81 / An artificial reference pattern creating means and 82 / Actual image reference 
pattern logging means, ] An object position detecting means and 71 An object arrangement 
reference database and 72 An object arrangement judging means and 73 83 An actual image 
reference pattern storing means and 88 [ The second depth map storing means and 93 / A 
depth map comparison means and 94 / An initial gripping position calculating means and 95 / A 
position-correction-quantity calculating means and 96 / Object transportation device. ] An 
object position detecting means and 91 A depth map creating means and 92a The first depth 



map storing means and 92b 
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t-vyf-yy m®&%m <om.mmx'ib t» , 03.2 « 

[0 0 10] xfUtSttli, «*ro*tt4ffitt»clB 

fcT-fc^o EI3 2C07O — ^-V— h<DSTl 1 |C^3V>T 
Bfft*«A**tt, ST12TA^J$nfc2o©IiW 
<X-e*tB«p«*y[j:«MftS*t. STl 3K*>^-C, 




ff*>ftTK«i®ttW£j&h<5. 1213 Ht^D^momm 

»D+ lRflroMfeiLTl^S. Xf-y/ST 1 41,1*5 
5 K*SV>-C, ^o-^ I4^$&3ffi[gf+»8&l- ioT 

^ cDtoS^^ <9 ig Ut 4v>**ftHittA*W* t PI Cft 
[0 0 1 l ] 

i%wn>mikL£o k-rz%km] ±fsia 2 7-1212 9^ 

2 5 6 X 2 5 6*75:14 5 12X51 2l|i^ofc|i^ 

-fs&gtfsfct), *:£*<*>b«m * y u 

5M«A*l*|R|«)ft«- 1 # < frfrZ k^o fflMti t *>o 

[00 12] ±1203 O.O^I-ftffitCfcV^T'bx £FfH=> 
-KH^c7)^.^ttlca^fSr|giti-?>cDT% 02 7-121 

[0 0 13] £ 6>|C, 1212 7~02 9, *5,fctfl2|3 0<D 

k <o &<D/b£^fktf-/um£te^x\mmirzys&k <r> 

mm^&.5cmzwm\z®mk Lxwift^n. fcs 
«««)*&^r±, mmi-z><tofck®m-tzfc£>. »jswh 

[0014] [1131, H 3 2 \Z7jk£tltzM&fam$imX' 

&<nm&^km%t:n?<»x\ hbfritbmM&&\nn 
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[0 0 15] z<n%wtt, ±.mfflM&*W&:-tzlzb£ 

[0016] 

fc t fcfcftw 2 ^7cB^±fc7)S*W^^ - VB^?r4 
J&1-S2&7t£ifi'<*-v£j#fM&<h, XtyfrbXt) 

. [0 0 17] ro»^(D|||*q(2lC«5«ft:»«IS* 

30 r— ^"<— ^.i, %)<*:C)T|-?fex-^S:t)t(c^)ft:(0 2i?; 
7cB^±T-o^^^-^B^^^1-S 2 ISSocS* 
/^-vft^fSi, *>7*»e>A**iifcji*ISBife 

irzffinm^wtkzmk.tmfc&mmwk®to.zim 

40 [0 0 1 8] w«»9!©»#E3.C«5Bfcte3!8tt 
(4, ERtB^^a^^^y^^x^^^^^^-v 

**A*i-5»-OB«A^#a*JJ:t/«^ro«ikA* 
*ftfc, ^-*5«tt/m-WB»A^#a^»«U/c-o 
oBM^(0^)t£;^SrtT9^r u*m&7a 9tttfctt^ 
®X-Mi$.Zi?i1ti>v>XhZ> a 

[ooi9] c w^^cofi^Ji 4 \zmz<foft&®$im 

14, SggiB^^a^yyy^^T-^^f-^^*^-^ 
50 &ZAt)i-5%-<Dmi&At>*fQ>%>£V%-<Dm&At) 




(6) 



w mfoffl <r> ttfctt tft 3 * r w *B B ^ n y * ara^ 
BTBfSStifcBB&aBBi, «j»*«s«FL»*i-5 

[0020] ^(o*w©»*«5i^5iiifttea»iB 
14, BBBB&MW, BB&oB^BBBBfr&ft 

i-sttBBAgMBB£&¥B t , i&f#mtffimm* 
mrnmc m l t n v obkbb * £$-r 5 abb 

&£MMfc£jft¥ffc&. ®#B£SBBiiIBi:iB;fi?B£lig 10 
BBBwft?B&w&&5 2 o<&B«BB&£Bi- sugfi 
HB£j£3^ t -ctftj* s nr t ^5 1 -cfc 5. 

[0 0 2 1] :L<P&9]ron*«6tCtt*B#&B£B 

(4, ratHik£A¥ft^, bbb^b^bbbbs:*!* 
&bbbb£A^£ t , i&Mfo&mmm& t mmt&m 

tfLBB+Sftfl^B^Si&Bfcfc 
[0 0 2 2] rro£&0B*«7£tt*BB*!!a&B 

(4, T'O y * S*fflMI|yc y f £ 

zfa y?<Ds<T\zm ltbb mksba &ft&.-tz>mm 
x-htniMfo •? o y ? m l t %m-r znfc-? o y ? mm 

£*IB*B £ T'B$ Siifcto-pfci. 

[0023] - (ownnnim 8 kb zm$&®mB. 

14, •7vy*MKU¥9dfi* SWfilS^B^S; 30 
*BKBBi-5»BBBBt1-»3«i:, tomitJkvbs 

y?<Ds<T\z.mLxftm®\z.mwm&ft&-fz>mm 
xhhtftti&7ay9mLkWfe~rz>tti&7vv?mffi 

UMt+*BBB«*Bfc*B*fct>©-e*>3. 
[0 0 2 4] r 0*89101***9 left SHttteSilSIE 
14, aoEUKOHBA^BSr^TU :/Pyy*tt£tt^ 
3o#±(&ffiBA*#aa»feBbft5*ft*?*W3 

wifeort2o«jBift*a*!Lfciiifft'<TS:2aaw±a 40 
[0025] d «>B9]<ow*« 1 0 ic&zvsft&mmm 

»4, 3oJJU:0>BBAA¥«**rU ^Py^Mf 
©BBOfl 2 orofflBSrBB LtcW&^T i 2 a«j^± 
9KtM«rM<S- LTB«BB&4B1-5BB«yi»Bi: , 

Z>o 50 
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[0 0 2 6] wW^sjofi^Jli itc:tt&BBBB£B 
»4, «B£ftfc«ftroBfc©E«HBS:£lft1-5B«» 
B4B¥&£, BttBBft»&ftJbJt£BB?Sftft*>* 

T»B*j*flufrt6*BB«»£tf«B4B*»i:, m 
xt, 2&7imm'<*-^bfc&kmwmz'3titiz>®m 

r <ntm ufcBB b mmmm±^mc xixmbtut 
m«<D®frnmmffimbz}fc&i-z>innm&&®biffi 

[0027] t<r>%m<nn$?&i 2icmz%)imWi.mW: 
(4, BB£ixfcBft©B#:oB*HB&4B-t5BBW 
B£$#g!i, BBBBa^ft±Bfc{fcB-f*Bf*:<0* 
J^BB£*ttitttfSftJjaBB«tttU¥Bj:. 

T»Bw*^i-*B#BBB-gii:BB4B*«i:» b 
*b, 2K7G&m'<?-y.bmimwmz<££tv?>tii® 

SrffioT±IB<Slft^^^^ LfcBfcBBB^-frB 

B>tr o^frogggttt m b &tit&-rzffi mm&^m&m 

[0 0 2 8] 3t«5Rife«B.31$SB 

*r-*-<-*i, BR^*Bas±j«L3tift#Btta 
^*BR«J»attSr*fcBEi-5BK*att*liE#B*«BB 
LfcBBt , bit®. LX1E L^&m>b* 0 

SrWS-tSttftiBJUWS^B t , Btt LfcBB#»»^ 

[0 0 2 9] C03P^CD!it#JS 1 4 Idffi^^^BlKB 

i4, ®ft8m<D&m b te%?-9*tei^z>mmm& 

iff-^^t, BK^A¥B^£fiKL^B(t:BBB 
^*BBro»Stt«rtMEi-6BK»StttftB#B*«B« 

5 *»«r*iJ3e-J-5«ft:E5UW*¥B t , BB UfcBBa«l5 

i-ifffirB^BSr^rt-aBBftiaBBi, 

[0 0 3 0] -c:roBW<0B#«l 5ldB<&BBB9BB" 
14, ^ifl?i|0Sipt^57 ? -^^tSifrt-r5^i^-+}*7 :f 




[0 0 3 1 ] r<0«9!<Bllt#Jg 1 6 £ffi£ft#&ttgB 

5J:5l!:»fH-«J:5K«*UfcH**!ai«lti:, #3* 

[0032] droawoaws 1 7 icttsHife&agB 
(4, aa^*ixfea«<o»*<ft«cwiiiflnA*¥a*»e>o 

BtiB<fe«r1*«fi1-5m-wK«liiitlt&«ft#iS:t, croi- 20 
**Sr*i:ai*Lfc#>fc©ffiJWB*fc£U r. coffin 

[00 3 3] ^(7?|g0J(7)W*]1 1 8 {C««4toflc»tt£|t 

f4, mft*ztitLm&<Dtt&®#(r>wGi*.jj&m*t><r3 

mm^mmm^ntz^.mm^k. %-<»mm& 40 
$ hftmffiMfc* ttm-t 5 tmrnrntik 

«mt«**J&L«Iffl*G«M!tltt©**ffi*1lirjEi[t L 
[0 0 3 4] 

[38MroHlfe«^fil] 
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$tifc#a»«)ii«'S:BI3lc*-f. wC-C-14, 

[0 0 3 5] 01 (C*5^T, 1 1 l40T^or B 1fi«r*JV^T 
2liBBA2>#&l l©«f£LfcBfl!^<bi»Mgi££ 

<ai-5E«iifft*fiii#a, is»Efiiifk^e>ft±aiB 

B\ 1 6(4^^7*- 1 7 tt*jfr+&7 f - 

1 8tt2»7cW*«J«Efi[lt**tbi-*<» 
tttt«fttt]¥lk. l 9f4^ffifi^W^©l 8CJ;ot 
fcffl Sftfc^ftffiBi ggBBoEKBtt B 

[0036] @3<7) (a) ttHBA*¥S 1 1 im ft L 
/iHilftL ( b ) li*±SSifiB«ttffl#B: 1 3 ftbti] L 
fc*±S«{«H«. (c) f4 2&7c£ii^*-y£j&# 
©Id 4 9 ftfls^-ffif*-^ fcfflv >T£j£ **tfc»»^^ - 

y»f^i/-h, (d) \tm±.wt.®wm.frbmm$ 

[0 0 3 7] ^T^STl 0 1T\ 
t, WBA*#&1 l i:ioTB3 (a) fc^-fBmaj- 
ftaHBtf^HB&ft^gl: l 2|cA^3$^5o ^r? 
7 , ST10 2f(4, RMilft^^ftl 2fc4oTlE8i 

s t i o 3 -c»±a*ft:««ttta^a: 1 3 <t «9 , a 3 

(b) jcii%+*±S«)i»#JC*Ba-*-5**S:to*±a 
^ftM$ri s ttffl£tl5o ^T -y7*STl 0 4 TPHitA^ 

1 1 xwt& LtzWMm^mm&&m^& 1 5 

itoZti, ^f77'ST 1 0 5XH2^k7Lmm^^-y± 
**ifcB*&fc i 1- 2 Uctc^-^ t LT<o«tM*- 
-hiWft, 12 3 (C) 4 9l:f^i/- M4 

[0 0 3 8] ^7 y^ST 1 0 6T'I4, 2ffiT*SS,^tl 

«©{4ttl4^iEmT'fc?.. XfyT'S 
ti o 7(c*jv>t, flM^$*tttfttfttt«ftttl¥tt l 
7fcJ:oTffiBft«>3*U ttfiftfcKtt; «fl!5 2^7cfi 



. „• 

W^-Cfc§ 0 ffi|Eftlbff>«m*H3 (e) IC*1- 0 

ti, HMMfr&^fki 9{c«fcoTiil28gStiiitl^¥©i 

[0 0 3 9] ->7°ST 1 0 8Ti4, t^TW^lft:*' 

a^ttcDptj^ryT'ST 1 0 e^ibfftfUtf £tk S'l 
K>#lft:ilM{-o^-C— jiOiOia^xy^ST 1 0 6, S 
T 1 0 7ASHlfi$ttS. fcU i-^TroftflEA^aStL 
TVMxli, ^f^STlO 9-CB««!faS:«-7*-ti: 
5, £JLh0>S9, Ciro»Wfc.fc9&<EJ*iIifc££j* 

[oo4o] mmm&±j$.^mt u-c, ^ra^- 

K{fc«fc«:AMfe«$rft< LTfflV>5 «fc 5 *>*^ 
[0 04 1] *&$I5tS^(c£<5^^ryyu- h-v 

Kfi^tzAK 2ft5cW«lfcU-C«Hfti-5*ifeO«Hc, fit 
[0 0 4 2] ^ fete. ft±»«ft:<aftffifrttttii-&Kt 
ff ±B 2 ffi rogggft @H£ & ffl v * T , %mm M C fc. 2 fig co 

mmm&t Lx^yyi^- y^-ox 2m<D7-y^y 

-Kyf^ tfnUmK J: o Ttt < ffiK Wi" 5 *te 

[0043] m2<Dm\^y^~-^\~ m*, — «-c*> 

9, Ell (c^Lfc#^S(DAtii^B8^!4 5 iijET$^*)^ 
[004 4] BMSI-^fcHMfefc* LT#Efr 



(8) #B3¥l 0-31742 

14 

[0 0 4 5] 0 2(72^-rs/7 , ST 1 0 5 Hfc^T, 2 & 
5E»fll/<*-^4)**»l 6(CioT2^7cS^/N*^- 

tzt><r>y-yr/y~ vf-y ■yiz.tetf vf Y 
LTMtH 3 o J; 5 *®&0>*6*Mfl$#«:* OWL 

■So 

[0 0 4 6] ^fy/STl 0 6 ro^ftfiS&tttfflKfc^ 

i^-hSri»w^)*L» ctib^m< 2\myfy- 

So 

[0047] ^X2/7"ST107 Tii, ftfttfJffifctftft 

[oo48] btemmomm 1 . x*i4, 

40 l, ^{ifi^m^Si 7^*JV>T<i*tlia«iC»SiJ!^< 

. 9 -y*£x?_ y fyy£&x&t>mn&<Dgi> v \t.yy. 

^tx\ &teznm<ntomm®.®&*irix^5#;mz 
MLxtmmzwifczitzzktfX'ZZ). 
[oo49] tftffi&<DW&&mmB.&®mmmmiz 

[oo5o] mm<Dmm2. mm<omm2. <om&&w 



• 
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(9) 



fclsfcjjrf, 06i49>^ b'v h'tf-ismittoVi * 

mm i. omMWfc£i&*®<nm$z ! ?y?j>?i>x : f- 
nm&ttmmoMffii. trot: -?*><&. 

[0 o 5 l ] HMd^T, 2 OtiJyVJ* Ky 

2 i aw&Atiz-mx-b <o % m-aft-A^is: 2 1 a t 10 

^Z<0IS^A^¥©2 1 b £-?tft*£4vO^ 0 22(1- 
4, **JKMMftlA¥ft 1 5 , ^rfcr- 1 

© 1 8 «^uHt«tt^ft 1 9 fi^w^fli 1 . tm- 

[0 0 5 2] &TwWHife<7>^ffi2. l-OV>Tia5<D7 

T 2 0 l-CS^ON^tl-S^, 7^f^^f^/< 20 
2 0 0>«8fWA 9 , Btt#*'lfe£*l' LT 

^ + /^-.>«3t#®ttig6 (a) [Zfjk-tXo\C s *9 

( b ) fcstbfc j; Ky h zmmvomz.®% 

&A;^©2 1 a*iJ:VJISr«)BifeA**a:2 1 blcfc 
5. 

[0 0 5 3] fttCv^A Ky h/^-^tdo^TSi^ 
El 6 (b) |:*L/c7V^KyHl, wOSfclfc* 

[0 0 5 6] (sU) T*if>fcS,,.«<ft/Mc*5 (d 
x, dy) tcto.m-tZZ.kti. aiyny^bRI:^ 
"f 5£H&±tf>:/n y£ b L*«aod»ofcit»C/i5. 

znmzmmkL. E.ftmmnwMz^xxtyfr 
b®&*X'<r)vm*mzijmx'ibz> 0 u±wiw L-it-m 

(D-fu y?m&tfti!m%%W1k±.<Z>-t'<X<n>b-7'B 
\CttLxm9MLX'ff\,\ #^Py^rtJ^f£:-t-5fe 
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<DMB2. Vii, 1 2 8 X 1 2 8<&«Pft«-Cfltoft£4x, 

0\c\*®%s<*-y<oM&*mffi1rZ>®miim\-fbtiX 
#9. S3t&£#&$#W**ri>ftl£«triS4?tf»oO^ 
^•g-lcil^O^-^ £ 1 £ lc^«:«BT^»^5 «fc 5 

[0 0 5 4] ^^U^-pifiSl^TWA^J^^i:, 
7°ST 2 0 4T'7>^Ax?*f--t<D$:ft^l8:2 0#O 
FF$tl-5o Wc^fyT'ST 2 0 5-C^f^IW 
-? P y * *t^ttl§: 22K<fco-C*7 1 l^.4-Hft^M9 $ '41 
■5. 0 7 (a) *3ctt>* (b) li^WSrffil^Lfc^T 1 
U-^-HtfeO-^tWHIfe-CfcS. 0 7 (a) ££pi^ 0 
7 (b) Sr^HfftiPf^itt-tS. 7'D7^?7fv 

zkfrbft?. ^fi|S4xT4-<«**ifc«»©/h'^ 
Py?»H, a@ LTV^^p s>* b R^ai^D y 

y h^*-V7)5&&£4i/0^#, HSr«IMti-5fc«> 

bR\zttfc-tz&m&±X'<»G[.m : $:&%-tz>. smmfc 

LtRSBBlfOf-e b R 1^ — - 
{d«t5^*-^ffli-5o w4t«&BflR±Wfi5^«SHocf 

t^T'fc^o z<d&, m\m<DmmkLX{t, 

ftSsr«4rffl^5. Sl7P7^bR (i, 

j) , feW^SrbL (i., j) , ^ny^^X^NX 
Ni-t5t, fciii^±w{4B (dx, d-y) 

aSS»*6*t«S„. (dx, dy) 14, (SCI) 

4x5 0 z<D%mmm2. -c»4n=i exhz. 

[0 0 5 5] 

mi] 



UU) 



[0057] ztiumtmmnrm 1 . iiBurt**)^ 
3 id i o rsNmtt^ bs±s^(*ffijcti %-tz>mmtf 

tttti$4l, »<^fy^ST2 0 7T?tt, ^-<D®^A 
*¥«2 1 a, *fcl48-0>M«A##a2 1 blrio 

^-y|4^$4vTV*/«C^ 0 ^T^yT'ST 2 0 8-CI4, 




[0 0 5 8J ^fy/ST2 0 9m ±l2ft±©ffi^ 

KttVbti, 2imttsti, ft±JMto#wiNibu^JR 1 4 

ST 2 i o-e(4, tta$hfc-oro^Mi©ftiifi§ 

1 8 \z 4 o TfRm4ft#<Dtt*fctta# w-ai $ ntfttu 

$ft£„ *Ty7°2 1 IT, ft£Lfcft«iftf(!0 2»j7n 
fefif4, Wtttt£#» 1 9 K J; oTMIBEMHfttttt £ 
tt-g-SJV ^f-^ST2 1 2 X'±X<D%)ftZ®.?&Ltz 
tWm-tZl£X\ ^f7^ST20 9A>f,ST21 It 
-COJ&atfift 0 £ £ *U *7 1 y7 B ST212 ro^Wra^ 

[0 0 5 9] ^fyyST20 9A^ST2 11*TO 

5 ±K*±a:iB«**<«im* 
affi««a»#ai-4 A^^trH^S r £ K 4 o Tfr 5 „ 

ioo6 oi.jw±gft«L)t«t5{Cv z<Dnm<otem2. 

*£#5C:£tfS«r«i-C£>'9, 4M**ffiK:jfc$fc9'W.ei? 30 

Gsztmsim-ehz. ^tz^u^n^nntztfxD 

•ryf-is W<£ 7 o y 9 ■? y *f- V 7 & Jlfflf 5 

[0061] ^.<Dmmmm2. v\*#*y<Dtz 

LT, **7VimZ-ttLXl 2 8X 1 2 8I|ffl 

y^LTtK, tilt, ^py^yfy^s 
•^t-fXi LT 1 6 X 1 6I$WX?rSffl U; 40 
8X8lf, 3 2X 3 2i*S?nJ:V*. 7 

fnismiiZfat&ittz'Q&mtifmzm.mtzztbx 
[oo6 2] £e>ic, ;roas«)«fi2. -m, 

AKy ^*->£LT6JIca2fliE#l* Ky h&fflv* 

t->x-h<3Xi>&\,\ ^Wcio^t so 
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T\zfoliX'**-y*®&-f?>W$:7FLtzi6^ ftibfrh 
[0 0 6 3] &>ft~FZ>s<?~ytLX7yyj*K 

^7k¥#fi<&ft*lcfc3 - £ £%x.3 £ , ft 
i^Afctt*!; y Ml, fc5V^4«09> 

[0 0 6 4] s<*-y®ftm<nffii&%mzMlx 

£l4*^PJcD^a«^±(»fiJ^o-oT**)5 0 
[0 0 6 5] HJfi©JEMB2. 14, BEfcifc^fcJ; R 

.MM&til* 5SS«3?l«lc4 9 3 &t£i$<&«£W 

aico^iCfiWJt© 4 5 (cfifrts^ i w^Bj<D*ss0ij £ m 
^ £ xmmm*vo&6LW&niw w 

[0 0 6 6] HSgW^ffi3. mM<nBM3. <»m$L*7F 

*3vnt, 13-1914, mmmm2. k®-mmz% 

■tZtitoXhVmmitGtoi-Z. 3il4Hi;A^^©2 

i imtem&x'ft&Ltzx : ri'*mm*bmi&&<r>®. 
tmiki£.f&-t5i&m&&y' p y * mwfs, 3 2 »4 
i&M&&x®mm®zmtii-tz>&Mmi&mm^®, 3 3 
ttfi*¥*«©H**> bttai Ltzmmmmmc^ *xmm 

«, 3 4l4®ft?^®Sg«lpj^£, ^OKfiKfkA^Mtii 
[0 0 6 7] 0 lT*«2?,7)50N$tve») 
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^ST3 0 3tll 9 "CflfiSSnSWfftA 

7d y 9 atjfcfl-^H: 3 1 *> J:lMM¥fc«7'p y * SftJSW 

^fy7°ST3 0 4T'7 ^Af^^ft^- 
¥18:2 OliO FFt -So ^f77"ST3 0 5Ti4H-<7) 
lj^A^¥©2 1 a*fc(i^-cOH^A^¥©2 1 b?!>> 

[0 0 6 8] ^f'>7'ST3 0 6m 'BM'&M.-fvy 

5 0 111 10 (a) tel&te&l&7av*ttfctt^®i3 lfc 
«t o T}# e>nfcffi*«ftffi«BttlfflJ» A SrSftW l~* L 
fcElT-fc?)„ B^A^St L-T 5 12X51 2BH?<£> 

mmt LTI4 3 2X3 2||Oi|||tr^U 

ra*©*»-CtTV\ W*.'*^ y 16X16 
®^l-i--5i tT'#bix5„ ^T77ST 3 0 7TIJi 

IBteA?{£;tiEgiBf££ 1 1 1, «Jfs«KJiHi#« 32-e 

Mi^llO (b) (C^-fo ^-ri/7°ST3 0 8 T* 
14, iMMMr/tf 5/ * *tJfcf+*» 3 3 K J; 0 . ±R«* 
M«g|5# (B— AWIMWB^) Ico^TO^., «t9«W 
f££co!E$SB& So :w«^l4K#»«il4l 

2 8 X 1 2 8B3f"t?*>3o ^.<DVSM\t.^n 
^a^^VT^o-y^-^-fXSrSXSI-^L, 

Srif^tt, 010 (c) lc&!HH%A&<o£ftH 

«C BIO (c) iCfcWC, (B(D# 

Kfeog|5# (croW) 14, S5#fc£Bg#Bife±fi!c0>iiig 

»"C*>5. ^f?^ST3 o 9-m, 8ESW^^#ia; 

3 4 <t o t JiCffittfeAEMm t i«#ft&IEBtBte 

010 (d) <D«fc 541 2 8X 1 2 8<Dflf& 

10 0 6 9] ^f^ST3 1 0W&I4, %%<»W& 
2. irEHBKl&aSih,*. ^fy7*3 1 0-Cfi, ft±& 

fc«3i-5ft±&«*#tta3;fc, ^f^/ST3 1 1 
TI4, ftditSf-^^-^l 6££M£n-CV^5IMi 

^Sl 7(C«toT2^7cS3S^^-^e»j6<]IC^fi£ 
$n-5 0 ^fy7"ST3 1 21?tt, ±Eft±»fl51H*# 

ltb^T2«bStl, ft±&^ft4lffittffl3M8: 1 4 |C«t 
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3 1 3-Cli, ttffl**ifc-o(0*fl:tjim«)ffiiliS»lwBB 
U ±E2!^7cS^<?-Vi, ±IB«K^iSffcttft«r 

!R*Mfc#© 2 »:5cttW±. fll«tt^ftl 9(dJ;oT± 

Wfc#ltt:<A3&7Gtit$fi£ ^fy7"ST3 
14T*I4, ^f^7 , ST3 12 1 S T 3 1 3 <75*n,SlC «t 

fc £ HWrSfttttf* fy/ST 3 1 5 -C'M3£if&7 i 4 

14, xf7 7'ST 3 1 2, ST3 1 3|CRoT*ft:«*t 

1)> if 0 *^*U3£|4, ±fBft±«ififfl##i*ffl $ ftfe 2 lit 

[0 0 7 0] &±<D«fc5K, dOHJS^«83. 14, ft 

5 r tir lt, <!>t£^mgmr$r-&^te&&<»mmm& 

[00 7 1 ] [£ft?&gSBPiB&f43 2 X 3 2B*, 
ftgfigfitBfc'4 1 2 8X 1 2 8ifi L-CffifflLfcrfS, 

30 *aao(S/j?{feSBgfiB^^roi^rai:, ie5ft?«S^-r u 
^^fea^l-S-arliJ: 5^ V y h!4^*?*b5 r 1 14 
ftv\ 

[0 0 7 2 ] tt««MKEmift£jftil«>x7 i^^J- 
B»t UTtMt Lfc^, [Sflfffeft^Tl'^B^t L 
Mm 1/2^1/44 if lc«Sii*-li:T#y::iiiilB^«r 

40 ¥S2 l<DCCD*p<7<75U>'X^X-ATs/7*$-li:, 

Wi&i-Z>£o^LXi>&\ 
[0 0 7 3] £P>IC, ttmmmz&B-tZ>yyyj»h'y 

B^tfi)cBf|ri4^#ft Ky h^^-v^*ffftv\ M 
50 [00 74] Il»ii4. %M,<T>WMA. <Dffif$.%7jk 
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5. 4 1a f4»-<0Iifc*MA#«, 4 1 b fifcHOlifc 

tttt^a, 4 .2 ttnaaHBAit-ii^», 4 3itm\mm 

10075] Xf?yST40 

^-r^-^&ft^lS^ 0<D*M#ONS.ixRK*t*to 10 

^ST4 0 3Tii, »-OliffcArt#«2 1 afcitffc 
-coii&A^^I§:2 1 blrjcot, tftitiftwxx u-* 
MtoWMftSft, S&-wWt>&^gM 1 afciiMg- 
tf>Hfjfeftlft¥S:4 1 blc*ft*ttiA2>**t<&. $ 
~Wii^A^^©2 1 a , 2 1b©2o<D*^7lil^i: 

fcfcl, ^fy7 , ST4 0 4t'7V^T!!'^ftS*f 

©2ooi^!jsoffut, ttfrfcaijsnri^fc?^ 20 

85-0>BfcA2j^S!4 1 aia0 7V^AK-7 

SsA D (d*,d v ) = EE IMrfx + <• rfy + ;) - Mf,i)l 



[0 0 7 6] ^Z(DH^A73#IS 21a, 

EBSftT*i»?, I-<Dl^fS2 1 afc*** 

7, »~0>HfltA*¥S2 l bSrfc*^7 bty&Zk\c 

«lfc#V\ SS-<BWfclMA¥»4 1 a 
*MAS*ifcSfc«r;fr»ifc, ^zroH^tSiJrt#©4 1 blc 

[0 0 7 7] 7ry7"ST4 0 6m »-*J J; tfSSi: 
C751i^^rt¥©4 1 a, 4 1 bKtelftSixfc.JXxLoj-jli 

'ME* (^d^) iu :/ps/*&lcfcfrcDiS{fc£*t 

ffl^S. 0tJx.tf, a@7*cy^bR (i, j) , &m 
tft*L'(i, j) , 7'o-^t^X^NXNtt5t 1 
£B{gi±0{4fi (dx, dy) ld*5tt58»JI#il6*MI 
Ss.o (dx. dy) IS, (j£2) T-S?£ft3„ 
[0 0 7 8] 
[&2] 



(it 2) 



[0 0 7 9] fcSbRI^U l Cfe) MMrftftU *0>S1H*;iW*iS*i,.5. C©^ £il<g>fi£S £ ftft 



S s ,.^ft/Hc:/j:S{i|l (dx, dy) £J$ffl1-5 0 ^ 
5 txag^P 5/^ b R(C*ft£;-t"-5fcB^J:<7)7"p 



^. («2) zmmLxmtz (dx,. d y > i;mu & 

[0 0 8 0] 



«MgH-*^S4 3KJ:9, ±|E (St 2) K:J:9nffi«lK [£Sc3] 



Scour. = 
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g (sM) 

i4-D 



i4 = 



\ 



j=i i=l ;=1 »=1 



B = 



>=1 i=l i-l 



<*5) 



N N 



-EE^+vi»+i) 

[0 0 8 1] (£3) tt, (5S2) iCif< «fc U EfilT-ff 
[0 0 8 2] ^T5//ST4 0 8m o y :?ft 

MiklMrt#a4 5fJl«Mrt**b5. «<^yy^ , ST4 0 30 

o 6 j; v mmn&mzm <o &t. 

[0 0 8 3] Xf ^ST4 1 OJSJ&tts "£M<DWM 
2. &n4Kfc*UBd*lS. X7-^4 10fll ft±S 

E*ttf«itti^« 1 3 kx <o , mmoit>*hik±wcWbm 

«E*BS-r5*±Sk«**«ttttlSH, Xfy/ST4 11 
jtffcftftOTtSf-^SflloT, 2^7cS*/^-V± 40 

ttfeti,T2«HbSft. ft±J^#««W^IS:l 

4 l 3T-I4, tttBSitfc— oro*#«m©tfl[lliS*S^B8 



N N 



(«6) 



14Tti\ Xf5'7'ST4 12 > ST4 1 3(DtoaiCj; 

fcfc«»r$ftfttf;*7 l y:/ST4 1 5T?&3#i&7£fc 

tf, XT7/ST4 12, ST4 1 3l:MotWii 
4:«im-*-5ftyi**9 3gi-. 
[0 0 8 4] £Jl±.fc5K:. ;i0>jfcjfcfl>ft1l4. -Ctt, * 

[0 0 8 5] fc#, ^<»%M<dWM4. "Cfi, Siil&SI 

ttfo«rtefflUTt«t^. nm<Dmm4. mis 

[0 0 8 6] 4 it, z<d%M<dBM4. 14. KXftMB 
«tt**, *flr*<c9MHAttilC(i*JV^-c, WHS KB 

/2*fctti/4tv^ofcJ:5»J:lS3£LTa^UTfcJ; 

<, *<o^-g-ici4fctx.±f22asws<asi+@ic«ffl 
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(14) 



<ftffl¥-l 0-31742 



[oo8 7] $p>(c, z<nnmmm4. n, t-ctw 
[oo8 8] nm<DBM5. mm<nnm5. om^m 

"77* p ytm%m 1 3, »f^©flE*l«r^i"7n-^^ — 
h*il4|;^f 0 01 StC&t^T, 1 3 ~ 2 0 ttUSS 

5. 5 1 ttUffcA^S-Cfc 9 , m-<nm&At)^&L 5 
1 a , %-<DW&At>¥m 5 1b, 35Hc75iIHg!A7}3M& 
5 1 c(0 3i3WjX-X\<^Z> 0 5 2i$X J rU*mto.'7a 

[0 0 8 9] XfyT'STSO lT'«j!g^ON$n^ll 

3 ~ S T 5 0 5 t?tt, Si?-<75iIHg!A7J#& Sla.fZ 
5 1 b, *»J:09SH<&lifllA2j#«5 1 

AfgiSIa, 5 1b, 5 1 c I4CCD7J;* 7T'fc9 , 
WEg$ivCV3. r ^T-li(gH±3o»*^ 714-tti 

7ffiE(4, ±IBHJgW^2. ~4: 0^(0 2 0©^ 

[0 0 9 0] MtA;W^77S<tlsJi$tc > Bfcii-tft 

^ry/ST5 0 7T'yy^A-r^^f L -H'/<^-^7t 
^2 0»7y7"M!OFFU WSI07^AK 
y x7s/7*4 0 7T*I4, 4>&<75f| 

z»itA*fg5 1 bdcto-c, tt&vw&mm&tf 

[00 9 1] ^y/STS 0 8Tfi, ^f^lS7" 
D5/^*f/Sft#|8:5 2K.fcoTX7l'*Hfc<D#j£tt& 

ST5 0 8-1 h tTtD»^7 y/S T 5 0 

8-2-Cfi, B-WH^A7J^©5 1a \Z 
±Z>m&km-ff3WikAjj&$k5 1 b K 
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•e*bfcftli:isi«i;ff5. z.<Dnfo<nMM5. -ett. 
D-7^rr<bi^*^7±T*t^^^75o [2116 14 
Lfcfcff)ffe5„ 11)16 (a) 14, B«*ffc*jfci: LT 

fc*v#-;u«<0»£\ mmzmw<D7 j ;\>A±<Db<D 

-^»3fcai2 0^rtrof|feroflHWK«*»e)©3tx kmc a 
RWitlcioT, El 16 (b) ro£5fctt«Rfttt&*l£ 
£;h,57p y * J>m±-fZ> ZtfrhZ* Z.<F>$®.*.%M 
£14, mZ.ti<P$:**7 5 1 b -Cttx-ygBldSLSlt^ 
®^oT^^^(75(C, £j(M7 5 1 a T'(4ig-oTV^5 

*<7)iii^(75^{ci4^i,t?# 1 1> 9 ♦H#$§£7?> <> 

rc0ttil3lt5feIli^777'ST5 0 8-3lC*5l,> 
20 5 0 

[0 0 9 2] X777ST5 0 8- 4tll > ^fiWM 7 
^«ll6t^-(75««l«k, *7J>7^ft^L7c^Hc75® 
&t <75PdlT'7*n y * #jfttt!i*fiffct>*l5. <^** 7 Id 

J; 5Mfc£7*n y * (c^fij u * rt icatjfc-f 

5^$r**^7lt±fffift5. w<DB#fc±fB<75*tj& 

X7y7"ST5 0 8- 5T*l4 ±f5 c t : '*:7J^ 5 5 1 b t 
*r«#* 75ic iroa^ttT^bftfcffir^to&fcBB 

1-5fflf«*S, ±IS<75^*> y 5 1 a t<P$;j}* 7 5 1 b 

r{c*3(t^'W^^:7 , o y^<75{isi<75rfl(ci4fpiba:s 

WftBBfftt<cv\ ^*>e>o^7{r*Jv^rt>, **7J^7 
5 1 b(75ii)^4rSipi: lt, tztt^j} * 7m&±% 
tt*LTV^<OT, #^70tff*^«^Py^fl|«li, 
t>**^7jU^±<757*ay^^{4-C^X.P>ti, S*fcJfc 

[0 0 9 3] V>*, fe-f *^7IC*J^Tttf*a«^« t 

40 IttilWK&tte^tnmZtllZttbtt. Stt^Oy^Ji 

4v^7«rfflV^W-»$ft5. Pi^irfcKtffft^flfi: 

tWHU tiUEttttttftfftlttb*. 4 J **P<7(75^7*D 
y^JC»LTim««>ft!.3I«StT4*3H, ^777*ST50 
8-6-C^7 i W'^-*H£:<5»t*aa^7-75. IP*,, &- 

50 [0 0 9 4] fc*5, x7U3j-m^(C*>»t5IS^g|i 
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27 28 
SR»C*J^Tffl^6>tL5«(H«fH*#afc UTtt» ft<0 * [0 0 9 5] 
K7) OjR«£#il&*H£S«.. (dx, dy) Srffl^ [&4] 

So * 



[0 0 9 6] &t£, 01 4Wfy/ST5 0 9-Cfi, 

[0 0 9 7] ^fy^ST5 1 0JWP$li, HS£<D^fi 
2. ilSJ^K&Jl&ftfc. XfyyST5 10m 05 

roW-^Sot, 2R5cg!M*-y£##&l 
7 Id J: o T 2 ft3c£9/<^ .§ ijffjtc£fi)c£ ft5, 
7f^ST5 l lT*fi, ±E*±©ffi«7)5ttai$^ 
fciSfctf, &±©ffli*ft^ro®<D2oK#ttP,ft-c 
2«fc£ft, *±a*j#«*ttU¥S!i 4{^J:oT«k± 20 
a«J*<R1t«)-oiSttffl$n6. ^fy/ST5 1 2V 

2^7cS*^-^i, ±mm®mmmmzm^x, 

f+$J£ft&fti£ft5o £»J:5fcUTft£Lfc«lMM* 
co 2 ftTcffiflTHT; titfB&c-^JS: 1 9 K J: o T±fE£j& $ 

<D3&7Gttf$Bi L-CtittrtSo ^T77'ST5 1 3f 
li, Xfy/ST5 1 1, ST 5 1 2CDtoa{dJ;oT, 
1-^T<B»fls:«:»«LfcjK S*»«>*WrfcfTV\ Ltzt 30 
Wtf£ftfttf*7 l :y7'ST5 1 ttl*), 
fSSfc LT V ^tta* * 5 i: fUK £ ftftl* , * 

f^ST5 1U ST 5 1 2ICJ§SoT!|gJtt<£*t&J6tti 

[0098] w±^Lfcj;p(c, z.<nmmmm5. 

X\t, W^A^#©5 ico*^7 5r3^ffioT2*lco^ 
[0099] z<n%m<nWM5 . T-tt, 3oco® 

tt t £fr 3 i 5 t-eae Lit <o , jj*y fmkz^fmx'te 

^ X 0 ££■ Lit <Q . 3 ocDfttft^ift-f LfclUJ- 

[0100] <cjs, mmcnMM 5 . -cwt, ft&ttfftiut 



[0 10 1] Hlfe60^S6. HJfeco^ffi6. rofllfiKSr* 
y^EI&BI 1 7, Wftroiffift&Tjrf 70-ft- 
h£01 8|Ctt;1- 0 01 7(C1*3V>T X 1 1~1 3 X 15 

~i7, i9 N 2\\t%M<DtM\. tm-mtfe&t-t 

[0 10 2] xfy^ST6 0 1 T\ SSR#ig»lcFft3 
il&A^IS: 1 1 CD2oCD#p< 7 -CSt*^lfrC0Bift 

arapfft£jft^gt 1 2 ic a^i $ ft, $ ft 

fta. ^f^sT6 0 2t% vmm&±j& 

#©l 2|cj;oTJ-fB2tfet07.r u-^-jffl^^^-r u^-r 

[0 10 3] *x;y7°ST6 0 3 X\ PHfcA^S 1 1 
t J; 9*«*ftfc«i!)5]BW«^«iK«l««l*iW^at* 

ftttMBfk*a 1 9 (a) \c7rrf. ®mm#-fr®*$ 
(nmftvxfo&X'ib v , *ftfc#ffl«jwcflNii*ftT^ 

LTttfflSftS. 019 (b) (4, tttti£ft 

i£t>*£ftTV^ 0 

[0 10 4] Xf-^STG 0 5T?I4, 
t — * Lfcfe^fer- * * 1 6(c^$ft 
fc7-^*fflV>T, 2^7C»Sp/^-y^#©l 7tC 
J; o Tfefrco 2 ^t£^ * - >- *: L fcSW^ 

019 .(c) tC^COS*^. 

^-vcom^0^^-t-„ 

[0105] eiT«>»f^«>»w*«, znmmmme. 

^coia^^tft^-o^SftSo <RIttt»±01 9 

(c) Id^^ftfct^^tCO-Cfc?), ClCDllJSCD^Ji 

6. rwffiltt^ r^tsiij tW&o <SIft«0i9 




U mi 9 (b) aj:9ttftJM«**»jfrt-&2* 

Timm**- ^<Dm&-&*mmi-z z. 1 \z «t o x% b*i 
9 (d) wipi^^z^TcWfig^m^tvs, 

±.mmm^<D^x'^\ 

[0 10 6] ^fy7"ST608m ±.til1R®.tf%% 
T-fc S t^t^^EE £ft5„ MftgStt&tiE^Jge 514 
019 (d) cD£9&<KiftWfg>££$U ^fr^lilA> 
e>6ST*(7)6<@Otif$:<7)M-^-a:|c:J:oT, 019 (b) 

SrlW-t-5. BP<b, ±iE6j@roW*:^MKJ;oT£/££ 
*i<5<KHftBfti:, ft±SOTffti:«:tfcRU toli:4 

'tt-C*>5i:*UJ&1-5J:5^»ifH-5. *ry7*ST6 0 
[0 10 7] ^T5/^ST6 0 9flt Xx^7 e ST6 

0 6*»e,sT6 0 ss-e^ftiasr^jtfensffiR*-*-^ 

•SSTift!? ^X->7°ST6 1 0T?I4, (S 

«SrtfcttU S-bSi^Ji^Sr^o^iJiSrS^ @ 1 9 
(e) (f) 14, *ii-e*vSiJ<0{Elft2*Jj;t«RK3-eife 

[0 10 8] *r y7°ST6 1 1T*I4, If ®.m%^Wc 1 
9{C«fcoT, itBOftt J;V«(cffi^i-5 2&5Efifi 

[oio9] ^<Dmmmm6. 14, m&mte±i&&m 

t LT2o<D*^7{cJ;5^7 1 U'^SrfflV>y fc c!6?, 3o 

«> J: v\ roUffiw^fi 6 f4, gg^liij^ 
S arc, IE«Hfc»£jfc!Ef8;tt£A,fc 
[0 1 10] rc0^iS<O7^ffi6. 14, {St&Wg-^ 
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30 

[oin] it iro**o»iB6. x\mmm<» 

[0 112] ^cDHJ£^ffi6. T'14, 

[0113] §6^, mmmm6. xn, -t^xo®. 
[0114] n&o^fi 7 . %m<Dwmi . nrnfob* 

h&0 2 ltd^;^-,, 0 2 0l£*5^T, 11~13, 15 
~ l 9 (4HJfeco MM 6 . tpsJ-^fc^-fS 9 

iftp^(4^K§i-5 0 7 lttiftflffijijamr-^^-^^ 7 

2 ttfcfMEJWJfc^S:, 7 3 f4g&H£^©-Cfc-5 0 

[0115] -ron»ro^7. {4, mmmm.6. <n 

30 1 07P- O^y-y-fS T 7 0 1 ~S T 7 1 1 14, EI 1 
8©^f->7'6 0 1 ~6 1 1 ilsJDTfc-So 
[0 116] ^r^ST70 1 ft £ 

^4^#©lcA^$n, iB8iJ(£fMA$H«. ^7y7"S 

T 7 0 2 T\ KfiMtfe±^¥© 12(Cj;oT±f52t!c(D 

•7^v^x*fc5!e:>stti4^<, «^.tfio6«>»a2. ic 

* Lfc * 5 Lfc^r v*mtx 

40 fcoTti^o 

[ 0 1 1 7 ] s/_/S T 7 0 3 Ti4, HtfeA**a 1 

5o ^fy7"ST7 0 5m »tt«j#ro-+ife7*-^S: 
ttttUfcWflr+ife^-^^-^l 6Srffl^T2&7cS* 
/^-V^^lftl 7t«toT«(*:0 2ft7cW*Hfft^ 

f7 7"ST70 6 TI4, «#«IM»i^«iRK^#gl! 6 
50 4lc<toT, ±EttW$n7tft±IS:35^iS^^- 




lfti«IIKi(0^fl86. T-iftWL^t^O|21i 9 (d) 
tew Stilt t. ittWChS. :ioiWS7. 
^TWu {Ktt(2Bll9 (b) <DJ:5fc*±a»{MW** 

0>8SKJ:oT«yiU 019 (b) <D£ot£fk±.Wm 

{4fi^W^©6 9(CJ;oTigi 9 (d) COj;5(C±i2ffi 

ns. ^i^ffiB^wii, ±.&%#iZtiizm®mm®.k, 
mm^^mLtz^y i?m& t wra -cr >:/ u- h ? 

[0 1 18] ^f^ST 7 0 8T'(i, iemftroljjft: 
0 9TU ^fy^ST 7 0 6~7 0 8<D®m%%Z.b 

[Oil 9l'^fy7'ST7 1 1 T'li, tt^tt^S 1 
9 £ i o T±iBMftT'ft t J; ^ffl$L\Z.n%i-5 2 fcTcfl: 

© 7 2 «t o r ±!5*&ifrt $ titt®m&%& , "rtbmmz 

tltzJE L ^Efllf*- * t Jt^T-fi* L X l> 5. 

-*7 itc»*fiSixfc*aBK*(*:|cJ;o-c*if>P>nfce 
3?iJ/^-^t?fc5„ W*.tf, C©*JHI«>^«I7. J: 6 St 
$*U-5«fc 5 *«J«X»JCj3^Ttt, Bflfiftfttt 

u> tm%-'<*~-yi tntttii't^y Y±.^<n®<n& 
[0 12 0] ±l2^iB?i)£35ir-^-<-^lci4^c7)J; 

^-yt#S:L,TV>JiCV>4l^{Ctt, ^fs/7'ST7 13 

fcfc^T, *#5S^a7 3KJ:o-c|gE«ffl#^±tt 
^fj'T'ST? 1 2.cfc^-CBl»£S^iEUv^-;v 
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K^tTftfciiSw i.cfcS. BSSfcKifti Ltli^f y 
7"ST 7 1 5-C»ff«rl*T1-5. 
[0121] z<omM<omB7. t*«, :ro,t p (cifeflc 

i: Jt m.t 5 - 1 «t o r ^ $ titzMmft <Dfr if o ri> & 
[0 12 2] ftfc, EMSfk£lft¥ft2: LT2o«*^ 

Affile J: 9 LT fc |H]*<D«)*S:*-f 5 C t tt^ 5 * 
20 X-t>t£l\ 0iJx.fi> Sg«m^4^©t LT, HigO^ 

LTtJ;t\ 

[0 12 3] BWeft^TAftM^ii^^TiJ 
30 0Sr*±i-5«*RWUfc*s, aJp^-^iOWfi** 

ibtg^W^^Jg $ ftfe^^*c7) ]E L $ It U"</W 8 "C 

40 [o 1 2 4] £ibK, Lxy^-tm^m^. 

[0125] mmmm8. mv&mms. <omi&%7F 
t^n -y^El^[2i2 2, m\^<r>mi^iry^~^-\— 

h ^rl21 2 3^1" 0 E2 2^*51>T, 11~15, 1 
7, i 9 ttntfcrojgflg l . tPi-ttflgSr^ri-Sfcro-eife 
Hlc*J^T, 8 1 liWco^j-fex- 
^ Sr t b IdAI 2 t^TcSiP^'^ ZQntiiS Axmm 

50 /<*-^to**«, 8 2ftm&ki%mm>bim*t&v>># 
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[0 12 6] ^fyyST80 lXmW.tf&Wi£tlZ> 

«Hfft4j*#ai 2^A*$n*. ^f?7*ST802 
Ttt, ArtStifcWfcfcffllvc, EgJtii{fc£jfc£8: l 2 

Tte<!f(DJ;5ftt)CQ-Cfc«fcV\65, -<0^ig(D^ffi8. T' 

5„ LWot, iffi^A^^©Ji2o(07 i Uf *^7^ 

*>> _3tett«r#*TLftV*J: 5 IcgaBSixS. «»J4AIH]0> 
@ J; p fc# > 7 fttt^fitf Wr lefts «t 5 tdSBEi- 
5„ *Ty7°ST8 0 3-m, ±tBB^A^*S 1 1 CO 

•♦MfifSl 5lc**«rt-6 0 ^coj®H^ii s .hfBSE^iW 

£x.ftv\, 

[0 12 7] ^fy^ST8 0 4m KS£IB&£ffl^ 
tttti Lfc*±«to*<BlK*tt:, @3 (b) 

imxmmfanx^zb^kmmx'hz, 049, ft 

±STO4 r 1 j , ^HJWfl-cofcigcii roj ^5«t5td 
2fitwiffi^i LT^m^ixSo ft*>\ rroHSgco^ffi 
8 . K:teV>TttB«*hfe£&)J?— /i^ro J; 5 ftffiftcofe 

ftttl/CV'S. ^.^5/7°ST8 0 5T?tt % W^gcr- 

©8 l.(cj:oTAX2Jfc7C*Jp^-^4riiS*i5. 
wixttH*0»fflll. cDt»PJ|c*3Ct5 2^7ca^/^- 

03 (b) I^SnTV>5J:5/j:»ft:o*|*|JfflJ^ro^* 
[0 12 8] Xfy/ST8 0 6T*tt, ttffl^ttfcftJi 

»5-ottffl$tv5o ^r-Ctt, 2ffiT'S?3i$*l,£ft± 

U ***B«±-CI4Je»/<# - ^ica 

■jmsi. cDUi^ic*5tt5ia3 (d) tmrnx-hz. 7,7- 
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mmmm&m^®8 s^c^^x^-y^m^m^ 

ztzvo&mx+ftx-hz. imfctbnm^m 3 o» 
vxh&o 

10 [0 12 9] ffiEfcfc&SCD&ll* LTtt, 

-9 Xh 5. SMfi^K^fi i'^m $ ftfcfcrfm^iWB 

7 1 5'7"S T 8 0 8 T'li, ftfe.*lfclWH«9*-# 

$ tvx v > 5 IRS t # v J: 9 A # i ***5*»tr#ll«-t- 

U ^r-^STS 0 6*»e>«!.a«:IH)SU Wl>*53iJW 

[0 13 0] ^f^ST80 9Tli, XMUBP'** 
— y« Hi-L#a 8 2 »C J; o X , ftK-^l^^tti S tbfctl 

8 3fe^$tv5„ HH^^idt, ftKflQift«MA 

30 ff 15 fc*#!Snfc»*Wiifift**!*L-, 93 "9 tti Utt 

[0131] ^t^st8 i om mmLmtkm^ 

40 fflV^tvS, ±fB*H^S*^^-^^©8 3(Ct& 

[0 13 2] ^fyyST8 1 HC*5V^T»4, 
50 ttf**it«^-LT#«jfls«D3^5Effillftft»L» ±ffi*^. 
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^f^ST8 1 2 -etes&iftT-t-s. 4feft£>BIR 

2 ofcwM^u i o i ^a^Ftifc w 
[oi3 3] mmmms. -m, vmm&£.i& 

l4#feftS. 

[0 13 4] JHt0K?tt9. mm<Dftm9. <D®I$,Z* 

-t~7vytm&m2 4, ii^fogittiSr^i-^o-^-y- 

h£El2 5fc^f. HI 2 4tC:fc>V>T, ll(4a^A^)¥ 
« N 9 l l4Sg8tBfg<£fi!c3M&, 9 2 a tefg-oEgStBfc 

tttt^®, 9 2b KWi-<D&ffiW&&®i3i&, 9 3 I4lig 

[0135] mfromm*. ®.mmM£ivM,^£?\c 

[0 13 6]^f77'ST90 l-C«B#ie»*ix3 
iicJ:QEKS1R^£A$n. ^fy/ST 9 0 3K*5 

©9 2 a c^^tis. mmm&v>£j&*mb lxk? 

[0 13 7] SStB&Ko^TEU 6lC±oT«MU1- 
3 0 1212 6 (a) ldl4lOW^«l, fiP*>^7 1 S'7'ST9 0 

i * jwt* it*: t # *>miko®m*&m%- £ ti^fi 
<o, B&A^iai i x-m&&titcM®mm*.mz : g: 
astttvs. Ei2 6 (b) tem-<nmmm&mm& 

9 2 a £ fefcgJtBHfc«:J*3;M£* bfc fc ©."Cfc 

gg8S«fc»4, !B«fcA**«©*y9A»e>4(J(*:*T«> 

[0138] ^r->^sT9 o 4 -en, tIJJWeflrtt 
Eff»#©9 4 «t o -cre«Bii«*» e>%n»l«B«F(fl:fBa* W- 

5, «»H*E»ffiB*ft*i-*lc«:±IE*-«)ffi«lii««: 
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ML, *±«lcffi*+5***#BPibia2 6 (b) ic 

mm L^—tiSLmfrb-fexy-t v fcjwtfcttBfrtn 

riW5„ H2 6 (b) ±-Cfc8JW#|6]f4feffcfrl&], 

[0 13 9] X?<sf79 0 5ff4, tDJHffiWffiBfc. » 
Mlfgfc5D#'yh«U H*A;fi#R0>»» 
*Vlcnft«cSr-NPW»c:jiiti-5. HI 2 6 (c) KftfKiiB 

fbft7til®{4fifel4, K#*<DlM|s&thfc**T^ 

[0 14 0] ^ry/ST9 0 6TU ^ftiljg&lcS 

bteft*W-<5. 126 (d) l4r<DHatO»»9." Ofi! 
30 14, *±gMM«H*A»fe» iliS$nfctl^Alc:ffiS-r5 
[0 14 1] ^T77'ST9 0 8fli > S§8tBfSitfct&# 

K4 9{£BtfIEi;£!+iH-5 ( , r V>%%<T>W& 9 . "C* 
14, KKiBfftroifc'tttLTmWft^SrtT?. S&-WSg 
«B«*»b*ZH0ffi«Hlk*3l< wi^H26 (e) Hfi 
mm&tlZo C(D1)(4BI2 6 (c) -B#ji®Lfc^A 
fcttS-*-3«#B<&*#2o<0eKHfc9fSi LtSo 

.. *(4-o/cl-tT'fo.'? , ii»»f^©.W«t?ttv S$.MMmz. 

#?S1-5<Of4^^T'fe5 0 K«H«(0||^»*i:bT« 

IW-fS^tti: LTI4, 0t|K.|4H^jl^S r 2{I{kLTm 
50 Wfcttffl£ixT^5#ifc!J<*fflT#<5. 
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[0 14 2] @2 6 (f) tt» il«Utfcfc©ta;*BT 
6*T.fcffU<W-J|[UfciEJ»{fl[jljJJ**oT*J9, ±ISS 

(0 14 3J r<0^/Rfc*5V^-C, Ptf'y H4^$7c#J$ 

#o-C, ±l5&fi*iiEi;T-*£ptfV HcaSSwtt 
£9 P*Ky Hi^fyT'ST 9 0 9{£*SV>T, iliKLfc 

[0 14 4] ^f'^STS 1 OT^TO^SrSSffiL 

W7t5*t^f y^ST9 0 2*>Pjtoa^*)ig 
[0 14 5] £U:««fc5fc, £©SI*lcflM89. 14, SB 

s fifj©ttf* -c^ui^-swfciaffltBWtii t je 

[0 14 6] ^<DMmmM9. Ti4, #]#]Je# 

fcflWE© 3 — ^-gcsr t £ \C 3 — b -fe<D*7 ± y 
ftR{fe£ *3lt 5ft±a®$ t **UsA*<DfH«& 2 ffipj|§< 

[0 14 7] Z<DmM<OMM9 . T'«, fjfrCD- 

[0 14 8] ^(D^JSo^g|9. -ClijgjffiSbf^ 

fM:£#5ll]f£i LfcrtS, 02 5(C*5lt5^r y/ST 
9 06*^ST9 0 8*T-(Oftia^i^ii(C|ltti-'5r i: 
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#s/ h*<»*Sr9ffero»fflc*J<l*/!R'Cffi:E*t]E*tAP 
*Lfcftf^*:tToTfclPI«roa*«:^ri-i. 
[0 14 9] 

io ffi^teffl^at, iUaiB^#a>ki|&{*:£flg*K:#Sl 

W^J-ffix- ^ * 1 1 lcf!i#<75 2 &7tiHiLh-Cro 2 &5ug 
> 5 2 &5££*P^ * - y£j##a t , 

♦Mft^Si, fiSiJKttW£ft/cft±a^ft«Ko^T 
2^7cS^^-yij»^H@f^w«f^4rffi^T^«:w 

«*(tltro«ia«* £ Eim<k£i&¥fttc: <fc o T#e>*i 

^trot-i < , .flr«tt*«i*i±-r«. 
[oi5o] c co^bj wts*3i 2 \z%^mm^m.mw 

wM-ffix-^ * t> b {Ofafcn 2 »Cx;H^±T'(0 2 ^^cS 
fe#}#a t , iagiJtcttW $ fob*' JOtftfMHftlcov 

Xh<0, Z<D£o\CLtzZblC±<Q^ ®#&MmWbL 

40 m.^m&nhnx-ttsz.bii^m.m.b ut/j^, siw* 

[0151] ^W^B^<75fS*«3lC^5iB^a8fi 

(4, E(iPiift4rit#a^7vyA/j;7 l ^^^Y^^-v 

^ * 1- 5 w®^ At) ¥a*5 ct ^ - omm a 73 
*ai. m-*3«ttj«m-oiiiifeA^#a!4«»«L^-^ 

&bX'ffif&Ltz<OX\ BBW**«jflt|c*tLT9^^AK 
50 y h^^-^jftjtsns/tfe^ affllcHlff«)*l>»Jft 
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[0152] ^<D%w<nm*^4\^z>mft®®mw. 

tt, Sgmii^^S^y^^^^^^^^-v^'^-^ 

[0153] 5 KttaHfc&aigit 

tt, EKHtt&ft^g!:**. ft«d^ftv*EMMflk*£jft 
J&£ft, *ft=«l1l|ro«Jffl»«fci«<-f5wi:*s-e#5» 

[0154] zv>&w<Dtfi#t%6ic&z<totmmmw 
tt, mm&$L&^mK ft«Aofe^EKMfc*£ift 
i-$mmmmm±f$.^m t , <£#*«£«■[«*> 

■«6&¥a&?«jft3ftfcKBtt9&C«:. ftttftti 
*ate»*£*>*;fc 9. ffii^aJM*IB]T\ Sifl? 

[0155] msnott^ricffissttMffiKS 
tt, 7py**tt£tt*a#, fi*ro»«;Hffc^oy^S: 

fcttrt m>zf xiyfMLk n-fe-rzw&y » ? * « aa 
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fft#i6-3»t«)fWlttfe*<«< ft 9 . £ft£#0flratt#a 

[0 15 6] d<D«IJ]roW#E8fc«$»ft*iJ8t 
tt, ^n-^ tfjfcfl^a^ &*<75m®^^n y 1 & 

yBy^ro^TlJ:BBU-C*flr«IK:9iflaflE«rtHlt-6*« 

-CifctVli^y n 5; ? HR L k Wfe-tZ Kit? O y * ft 

*#ae>*i<& <t 5 1- Uc^T\ ij^ffirotttai^Pfl^M 

mzftoz-ktfxzz. 

[0 15 7] ::roa&rott**9K:asH*aa&lt 
tt, 3o£t±<0ifiaA^a$:*rU 7*py^#lStt* 
a#, 3o^±roMifeA**«:*»6)»e>ti5-ttt-?*i/ro 
pj^cort 2 orowaSrSft LfcWa^T £ 2ffiH«±3I 

[0 15 8] oidasafr&aaa 

tt. 3o£iLbO«aA;to#a«:*rU ^o-^MWf 
aa*±B3o«±oH*A;&¥aa»&a&;h.5 Weft 
0>W*<Ort 2 OWpH0!£jSft UfeWfk^T * 2 «a w± 
MRU ^oy*#Jfctt&fr£V\ **i**i»*f«ft» 

*»*sr«s^ Lxmmm&zz.i&irzm&'&mmm® 
[0159] rwawoafcai i \^i>mmmmmw. 

tt. IXit$tt^«Cco«f|coEfiBfk«r±^«EKH 
k. ffi«H«fti»e>*±SfcffiBi-5 

m<»&%&&fflLirsmL&%mktaL ! £fkk. m&nis. 

m«<»®&<r>mm i &kzm&irz>'ft®M&*&kzm 

mmtzox* &®*®'«»timmmKi®x'±<, 
tt, swsotaftLT^s: tt^wet , 

50 *±a»(*:K)ifHi6»e>*E«H-*3J»**«+<5wt'b'C# 




3. 

[0 16 0] z<D^m<ntm^.l 2£{ft34feft:&gt$lB 
±affif£#*#jffl1-*a±aigfc#teai#ai, ft±a 

&ffioX±iB{EItt±l&f a#£j* Lfc^ttfgfiffl^-tirfK 10 
J: SfeiSotliLT^Slit 20 

[0161] ^cD^Bjtotf^ 1 3 imzm&f&mmm 

{4, to#K?Ualft£ 45r-^ &feflH-S4Mtie?!l£ 
$f-;S"<-xt > fiiR£lyfc#aas±/*Lfc#»fM^a 

ar*l^-**{WEW*U^a k > RSI LfcW&jjSgiliT* 

*£»±*a**ii-3 *><ot LfcwT*, .BMMfroat* 30 

'< 9 - v S 2p 1 4 S 9| if - y I c ft o x v ^4 v 

So 

[0162] ^nwrnrnm, 1 4 £i$<5ftft&*gs 
m&mmw&ktz%7-* *&m-%m$mm 

^z*&&±&mzGirz>m&ti} ! mm9.k®m&mk & 

[0 16 3] ;:ro38W0>tt#Jli SK&SWffe&Sgfi 
<4, »«*«3?iJ«D*qii:45f»--^**|ft-tS*flc-+at7* 
- * "C-* fi> b @ »«K:£j* $ *t4 AIJS*/^ ~ ^ £ 
m\ *T*i:ft5*(t:«){fl[K*tlfflLX, fcffi&llKfc 50 
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&m'<9-*®iotiiL¥&k, mvttiztitznm&gim 
'<f->z&Mirznm&m®'<fi~-*&iti^fkkZG 
u wft^Biiw^^fc^xttamEsiiBttiaiP^^-v 

tmm-ts «fc 5 teftfFT $ <t 5 fcflWt Lfc t ro-efc 9 , 
y ^i/J^$/«^^*^ot<7)x* c t < , HfeArtnSIBtf 

So 

[0164] w0>BW0>IH#i l 6 lcft<5fett&gt£{E 
- * -s-^ *>6 g Kittle $ fit, Allip/^ - y * 
^x»««jfltkffiSl-*a«ffl«*iW9m+SSliii(iS* 

Wl^w|giaWi^lc*3^xi4IIB^8^i/N 0 ^->-^iJffl1- 
5 ± o Biffs-*- * i 5 LfciiHfc&SiSfi t 

[0 16 5] wfl>«9!0>W#qu 7{d#5pi^a^g 

m* *imx°b 9 > mm*?*- y vm^»^\^ < 
s*Lx<>affl-cs«iai^mt>ffi< <c*. 
idee] z<D%w<Dm#mi 8\zto&thimmmw 

sgii^^f+i'j-rssgsiK^^^ai, suttztntm 
mmm&m-z%-<nmm®&ifo*w<.k, w**ia 

kiz Lx®^m&mm»-tzmtemsLmft** 

fkk\ »*»«^a{JiJ:oT»»:«:ie«H!tfl|-C*G«?U, 

m&z&Mi-z>%-<DV£Mmm&^®k, n-nmm 

¥at; KKH«roJttt»**«[fflUXiS«Ufc»(*:© 

x^tai-5{i®ffl]Eft^tii^a t ^w-r sii^age 



(23) 
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[023] £W,<DM1&8. <DWi^<omx^i-7u- 
\>X-tbZ><, 

I@24] :mii«Ii(oil9. nmi8L*m~f 
[02 5] MM<Dftm9. <0»f£w«EJx«r*1-7n- 
[026] «J»ffi«fffiltt1ltjEi-5«l^ro«-a»*r7i% 



[01] wO*w«)iiifirojK«Bi. wtM^^-r^n 
[is 2] mmmmi. »»^M^t7n-f 



[04] z.<n>^m<r>%H&<r>WM2 . <omi&i:n*1"7 v 

[0 5] HJ£(75^f§2. Wtt^W^tt^/T-r^P-^ 

[06] 7^ h/^^-VWflBWftWH-C 

[07] ^r-i^PHtw^p y^yf-^OWlffiei 
"C* &>?><, 



[02 7] fE*roM«^S§SKeD«ja*IR«:*1-R0] 
0T*fo5o 

[028] 0 2 7 id^i-iaarotd^o^p— f-Y- h 

[02 9] /<^-^3t*rfflV^fcagBI]3- K^oJBa* 
^1-0T'fo5. 

[030] fdiro^^joKStW^H-SJVx^AfDlftW 
0T"fo5„ 

[031] ^rosuroii^toao^T 1 ^^j^HHRS 



is] ^(omm<omm<DMm3. ©awiSrsM-^p 20 b0>im![8t*>5. 



[0 9] 3. <»mft<r>ffih*7Plr7v-f- 

[010] {^ttXEMfeA'bBIMttffifrttW 

[011] z.<D%W<nmM<DM1&4. nffitfLZTjk-fT' 

1012] MM(omm4. (DWift<nMft*7F-f-7a- 

[013] ;:©»*|©3|j*<&^ffi5. O^Sr^-**:/ 

[014] *JS(0JgS5. (Dtdf^<D)5KtvSr^'1-7n- 

[015] ^yu^Py^WJ&ttttflso^u-*-* 
- HT'fo^o 

[016] *r vxm&fOXT- ^Xttfcttnffi**®: 

[017] mSfjoXioilfae. oflf^Sr^i-^ 
a S'^0T'*)5o 

[01.8] . .HK5(Dj&f£6. ^»f^«)«nSr*i-7n- 

[019] «jflc{8!*tfiitt*fflv^-C«j»:|Sl1ltS:tttbi-6 

[02 0] CO^B^oHJSW»ffi7. ©Ah***"*:/ 
P •>^0T-fe?>„ 

[021] £lfe0>$tt7. ro|WWft7o- 



[03 2] tt*ft>8iJ<aiV{fe&aB9 3 0O7n-ff- 
1 1 HfcA*j¥», 1 2 £ffiH{fe£j&#8:. 1 3 

ft±ssffl«ttai#s, 1 4 ft±««#«M«iai^ 
a, 1 5 fttt*mMtM¥ft, 1 6 mw-^mf-^ 

17 2»S**/'«^-^4J*#a, 18 « 

(WfcflHftw^a, 19 20 7^a 

7^*^-V/<*-V«:#;#&, 2 1 MftA*J*&, 2 
30 2 ^fU^HifcyDy^JltJCW-^a, 3 0 y<^-> 
tt#*k 3 1 «tWMt^ny^*f(6ft*«, 3 2 © 
ll«ttfflf 3 3 iWtt^Dy^lSfta, 

3 4 SgptBit-g-j&^a, 4 1 a SS-oKfMMA* 

a, 4ib ^nwiii^t&tt^a. 4 2 m&m&Mr 

4 3 SHfffi«M£f+lf#a, 4 4 *W7*p 
^HMHttfK, 4 5 EMVfMWM, 5 1 a 
H-wpHg-A^a, 5 1 b SfSrcoMgiA^a, 
5 1 c iSHWiijfgtA^a, 5 2 ^yi^lHfty p 
y**«?ft#®, 6 4 *9ftfc^&-tHEK£lfc*fl:. 
40 6 5 {Slft^^tt«lil^a, 6 9 «$ttitt*a]¥&, 
7 1 .^flsESiJSJpx-^^-^, .fcftEWWJt. 

7 3 «s£»£#s:, 8 1 Axm®'*t-y& 

8 2 *Hfll**^-^W9aL^a. 8 3 

HiSifeSiii/^^-vftw^a, 8 8 a#&B$ffi¥ 
a, 9 1 gggta^^^a, 92a m-^mmw. 
itm^tk. 92b mr^ptii&t&^a, 9 3 sg 
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flfc, 07 (b) Srtiiittiri^-Srii-rs. ^d^7 
y f-y-Zit^m^mn X o icfc^R©/]^ a y y \c<ft 

5'<?-y*®mi-z B &m<njj&kLx%mmftm*t 
wk'Mk\z.xz&%*um-+z> 0 zh\ttEmfa±<?>mm 

(6i©1"S;ftl^By^ b R Srtd^ L&as fei£jfcfi;fo"& 
frit, t t o 1 1 1< t o t»JS 

( i , j ) , TiBifc&b L ( i , j) > 
SrNXNt-rst, £B{0!-ho{ifi (dx, dy) 
»*«*«iS$Mfi*HtS... (dx, dy) fi, (SSI) 
T3c£;ft,5 0 Z.<F>%%<T>W&2 . fliN=16fi)5„ 

[0 0 4 8] 

[fUci] 



#©2 0 a, *tzl*%-<n®i&Ajj&&2 0 bJdJCoT 
_ Ste$tiyS:»^ISB^!J5».^ISB«1«i^#l9:i SKfctt 
£ft5. ;:roi$fi ktitfbJvyj* Ky 

-VliSf^^flT^^V^ ^xy7°ST2 0 8X14, ^ 

7|C«toT2ft7cSiP^^-^g«lWlC^$tl5. 
[0 0 5 1] ^ry7*ST2 0 9T'li, ±!2ft±SE^ 

ic^tbix, 2<tfk$*v, *_ba«jflc«l*ttHi^a 1 4 




s t 2 i o -c-ht, ti\mzntz-^<n®#mffi<mmR® 

{£114, HMRK^fti 9K£oTimEEKHfe11MRJ: 
ifUt&rl-S*-?, ^7 y^ST 2 0 9*>Pj ST 2 1 1 * 

(0 0 5 21 ^ry/ST 2 0 9HST211 JfW 
«t oTt^TCftflttBi Lfc fc HOT Zixtitf* 
T77"ST2 1 3T*toa?r)^7i-5o -t^XntofrMi 

&K6MdWSfip£1- r fc ic J; o Ttf 5 o 

[00 5 3] JW±UtiWLfc4.5tc:, roH*So^«g2. 

wfie^F^/ix 9 * *J- -r fcflMi $ ixfc v ^ \s*m& & 

[0 0 5 4] £<&£*»^82Ttt#*7<B#fc 
St It, 10* ytaiftCttLT 1 2 8 X 1 2 8iijjf<£>7 

■fl'Xt LT l 6 x i 6H*wiM , X$:«fflL;fcas. 8 

X8K*, 3 2 X 3 2HSH*-ctJ:v\ Sfc, 

«>HMK fc &1* U <b JEMtX- 1£ < T t & v \ * f> -7 > ^ 

[0 0 5 5] $£>K, r©HISO?gJg2Ttt, 7^i» 

ffi@g|^tcoi>TI4, «»:|c*tU-C»it±*d»bllTlJ: 
[0 0 5 6] *tft*ti^-Vi UT5^A«ttt 
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y^*tj©^»t*Q!a^i3^T»«?j« a stem 
tm* v v m&'<?-yb ltsiblt trauma* 

[0 0 5 7] ^^-ya)t«<ofl|j**ifeij:BBL-c 

[0058] mmmm 2 (4, Kica^fc «t 5 m, bm 

jcS^^-Vi: LTilfeft:^^-^— iS^>lUMM«* 

[0059] nago^ii 3 . mmmm 3 
in 9 tc^-r 0 ei 1 0 Ki&M&&W£Mm>hmmwi$ 

T, 13-1914, gg%ff»ftB2. t |5J-«ftSr*i-5 

t<D"T»fc9BlWtt4fi»i-5. 3 H4iffl^A7:^l9:2 1*5 

«S:4ril-t-5fi*««^p y >> 3 2 (4{Sftf 

«*T«JSEffl«S:ttllli-saSI«R*tta#a, 3 3I4{6 

^WLXh^> 0 

[0060] ^77/st3o i xmk&ouzhmwi 

■f-St, ^fy7"ST30 2f, 7>^ '^r 

y7*ST3 0 3T'«, -*fco*7<7T-tll^$n2)Bi^A 
73^© 2 1 Id «t <9 -MroM©^7 U'*B^*5(S<S^S 

^18:3 2^A^$tt5. ^7l^tlf^ii^5i 




*T-y7°ST 3 0 A-?7V? J^y-V 7.*f-f<9 — V%i.% 
0I4OFF1-5. ^T7 7'ST3 0 5T1ii-(7) 
MA^¥S2 1 a *frttm-<Dm&At)^&2 1 b 

[0 0 6 1] ^f7^ST3 0 6m fiiM^oy 

**tt£'3»t*a3 lCtot^f i^Mfc^Ma £ft 
5, 111 1 0 ( a ) lite^a*?" n s/ ? *f JCSM-^S 3 1 (C 

fc!HT*$>2>, B&A^at LT5 12X5 1 2BJBtf> 

Bftt UT(4 3 2 X 3 2H*0>efltW«$:£jSiJlU 

ESw^ftT'fiV, ^Jx.(i7"'n s/^f-^fXS: l 6 x i 6H 
^ti-5^iT-#Pj4x5o ^fy^ST 3 0 7 TM4±IE 
ffiflf&gSgfltBfg!* >b 1 fc, agfflttttltti#a 3 2t» 

5£Hfc01O (b) \C7frf 0 yT'ST 3 0 

p y * 3 3 fd J; 9 , ±IBa«ffl* 

0>eifB«££jSi-a. ^ro^fiffi^^tiii 2 8 
teCT'2 8pi9ff-C*$>5 0 rro^tafi^n y ^vyf^fe 

^■pi^aio ( c ) iz&jtm*m&<owmikc$: 

e *tb 81 0 (c) te*5^T, mmUtt (B<D#|*|) (4 

tt^a&^Httft>b&e>;h.fc«^roa3gfttt, JKfitf) 

5. ^f7/ST3 0 9fli, EKBtt&J$#a3 4(c: 
J; o T J:mft?{fc£BgStB{8! t ffift &£IIg8tB{g!££fi)c 
U El 0 (d) ro±5*l 2 8X 1 2 8 OTfil&ficDgg 
SIB^#?,tt5„ 
10 0 6 2] ^ryyST3 1 OfiJlfctt, %M<DWM 
2. 4ISl*R(C*aaSix5 0 ^r^3 10TU *±J& 
B*«ttlffl¥ai 3 J: t) , £ftBttd>b*.ha4fe#B 
Kftai-**±JHH*i<i*a*ix, ^f^ST3ii 

^IftroW-^ftot, 2^?tSSp^ , ^-^4 

SilS. *?y?ST.3 l_2Ttt, ±e*±affi««# 
ttfflSftfcB&riS, ft±©Ei-5:ix^Wffi(75 2o^ 
»tt>ftT2ffifc$ft, *±a«#iSI1ittHi#ai4^J; 
oTft±a4&fca*t<D — D*«ttfflSn5. * ST 
3 l 3Tti, ttWSixfe-oroteftftlgroffilliSfSfcBB 
U ±E2ft5c»(b^-Vi, ±I2g^®B^ffi$a«: 

2 &7ttfcifite, UMRtt^ai 9ldJ;oT± 




0-3 174 2 



^s^ST 3 1 2, S T 3 1 3 COi&SIC J; 
ffiUfcirWW^ixntf^xyT'ST 3 1 5 T*&S£$*-7 
fttf, ^r^STSn, ST3 13CIotWi 
fca^a^JJete, ±ie«±affi««;6*«ittlS*ifc 2 

5 t' 9 j^P^S r. 1 <fc o Tt? 5 o 
[0 0 6 3] gJLbOj; HC, Z(DMM<Drtm3\*. Mclfc 

E«H««r*Iii*fll]"C»-C*5*, <»ft:o©SS»^lc:ffiS-f 

[0 0 6 4] ffiftftAEKBfkll 3 2 X 3 2BHf , ft* 
{$!&Sg$£Bft!l4 1 28X 1 2 8Ift LT{£ffl Lfc#, 

[0 0 6 5] te^gSggtW^^o^^w^- 
B^t, ^^ggBIB^^cD^xi/^-B^^mi: 

^SUgStB#^fifei)#lc ± t>lZ»MA^fS 

[0 0 6 6] £P>fc, *f^l:fijgt5 7^AKy 

[0067] mmnrnmA. mm<»Mi&±<Dmi&&*i- 
yo ytmzm 1 1 , mtnffitiZTjkty & h 

SrHl 2ic^1". Hi HijsVNT, 11~13, 1 5~ 
17, 19, 2 lttHJSo^jii in-WIB«r*i-6t 
WT-fc9rai4«BI1-5o HlCioV^T, 6 4»«#aa 
fi-fr-frfia^l^a, 6 5 (4<£iftg^tt&iiE#S, 6 9 
ii«j(WfcB«tt]*a-Cife5. 

joo68] ^f?/sT6o it?, m&timm&Hz 




<7)/W£/8£;ft5 o Xfy7'ST6 0 2T, Sg^tiii^^ 
[0 0 6 9] Xf'>7*ST6 0 3f, M&A7J3MS: 1 1 

&®mw\h&m 1 3 (a) icijr*-. <»ft»ia#-/Hiets! 

3. ^y/ST6 0 4tlg||I*lii6>fe, ft±©Efl 

frbmti&tLxmmztiz. mi 3 (to «jms*t 

[0 0 7 0] Xf^ST6 0 5TU ftltt&ftWtS: 

ai3 ( c ) \a<Dmm^ 
[00 7 1] &,T(om^<Dmma\ zonm<omte±<D 

©»^:(SBl^-o4rt*tt5. {gifttttEll 3 (c) 
r{RUii j {KK»B|i 3 (b) coj: 

y^u- Fvyf y^gfeiaotMIL, 111 13 

^fls&R^{U^S6 9(d«fcoTiai 3 (d) <D 

[0 0 7 2] ^fy7"ST6 0 8m ±12<RttjJ*»3 

113 (d) o£5&<KtfcM^£$u 
feeiT-coe^W^ftW^-tirtCioT, HI 13 (b) 
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8Ti4C<Oj;5(-^r-7 7 P ST6 0 6t*^tfc-oco 
[0073] *-rs>7°ST60 9 fli, * T •;/ 7° S T 6 

*«rtfcttU *ti«v>»fll*WoffiilttSrj8^. 013 
(e) (f) li s *n^»J©ffitt2*s«tOHRtt3-C*> 
5. H*»e>Wfe*»4J:5K, 2 tfftfcfc 

X 7° S T 6 1 0 >Ti!$R $ ix5 £ t \Ct£ S 0 
[0 0 7 4] ^fy7'ST6 1 1 T?tt\ ttf«*6^'#« 1 

«f*twaeE«tiii«i*siK^*^ ^f^sie 1 2x 
mm^mt Lxmm^uijjztixi&m&teT-rZo 
[oo7 5] z<nmm<omvi4tt, fmw&sz&^wtt 

[0 0 7 6] £<D*tt07Btt4tt:; (SlftOS-Stt 

[0077] *fc, i<oHl6<6^<B4-ci4ttfW5:ll«>tt 

h-wf-yy^-mzxv&mLx^itAK zti%2mffi 

[0 0 7 8] r«H«gro^flg4-C«, fD^ffl 

[0 0 7 9] %M(DWMAX'\± S -f^xnum 

-fctio- 




[0080] mrnmms. lirofiswM^^t 

&EI1 5lC7jvf 0 E)i 4(cfc^T, 1 1~13, 15~ 

i^mmmme. b^-mm^-t^-hnxh^m. 
wirmtZo 7 mwsaw^r 72 

[0 08 1] ^WHJ(g(7)^fl85li, iH»Jf^l4«|| 

7D-»^Ty7'S T70 1-ST7 1 111 H 1 2 CO 
*"ry?6 0 1 ~6 1 1 tmCXhZ* 
[0 08 2] 7 0 1 -C*^fi^g||,$tv5 

T 7 0 2 T\ EMM 1 2 Id J: o T±|E 2 tfcCD 

^^§H?)„ rco&Jlfl, Lfc^w^x w;f-7 
[0 0 8 3] 77*ST7 0 3m w&ajj^® 1 
llcj;^^^(D«^Miig^^A^$tv, S^®® 

±SB^*»m^ 1 3 (c «t 19 ft±is®^«*5ttai $ ti 

5o ^ri/^ST 7 0 5fli, &#Wfcc9^fgjx-*£ 
^iWLfc^^x-^ s<-x 1 6£ffl^T2&7nS*H 
s**-y$Lf$.^& 1 7 |C J; oTt)^C0 2 ^7cW^M^^ 0 

T'^ST7 0 6 ^&l£ttJja£*<K!&£/jJc*J£ 6 

Bitii^ffico^ffi6. x®,WLtckm$i<r>®i 3 (d) 
C^^fci^itOT'feS. rcoHJ£(D^ffi7. (C*3 
^tli, {Slfttiia 1 3 (b) <Dcfc5&&±©^#fi$£ 

cD&jfclcioTfeSU 013 (b) 0<fc5&ft±SE 
M^SrJFM1-5 2 ^7cS«/^-vwa^-a:^««1-5 
C t(Cj;oT#T^-5 0 ^r-y7'ST7 0 7t*li > 
{4g^Ui^6 9(CtoTEIl 3 (d) <D£?iC±.m& 

±E2^):%SS^i^^->co^lI5g^5^cotS»^ffl^^ x 
m&frbfetiiLtzx-vi>m&b<DfflX- ; ry-7i'- h-?v 

[008 4] ^T^ST70 8 T'I4. kfflm.<F>m<& 
0.9Tli, *T 77°ST 7 0 6~7 0 8<D&m$:%X.b 
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ti%iRm$:-t'<X±j&-fZ>&xm«)ML, ^"ryfl l 

[0 0 8 5] ^f^ST? 1 1TI±, tit faSc^lS: 1 
9 \Z J; o TiffiMftT'ft t ct ^{SlftlCfl ^ 2 &7c{4 

<DMfc<D 3 *7EWf4K^*flo/c r b (eft t> S£firt£|3 
lcte^$*i5 0 *7-y77 l 2TH ti^WI^S 

7 2K£^x±. ! m&m£fttzmm&$ki)K ^/bic^ 

/cE L V - * £ ifc-<T-££St t X Ir > 5 T^^J^ 

* 7 1 (C^^tVfc^fg^^lClio-C^JO^HTtlS^J 

[0 0 8 6] ±BE^ftia?iJ2ifi7 ? -*^-;*lcfi^cDj; 
5 ft S*P b i--< # ^ffcO&JWfEtfi $ tlX ^ -5, xry 

^st7 1 2\c^xm^tc®%:tf&mt%zm%-'< 

f-yb&$kLX\<^^m-&\z.te y XTy7ST7i3 

Iwfc^T, ^r3S£3M§:7 3tCj;oT^gffiffl#^±{fir 

^mm^x^m^^-oxw^^^ti6 0 **ry 

7'ST7 1 2^i3V^T^i^^EUVv<^-yt?fc5 
7 l 5T*«jf^Sr^7i-5o 

[0 0 8 7] Z<Dmm<DBm5X'i*. iWJ:5fc«S#* 
[0 0 8 8] /i*3, ffi«iS«^#at UT2 0W*^ 

5lc«t5^^^aSr, &mv>g%m&u<n%&b LX 

msim& b m^<r>m& t 1 1 fcttEi-s^feSr, 

Affile: «t <o xsl ur t>p]««)J»**ff-t5 i i 14^5 * 



«2. •eiawLfc^^->'S:efffl-f5^7 i u*«&, is 
wkDm&mttmt Lx&®)#z&®mw'i?-y t 

[0 0 8 9] sj-fc, BMWm^7»ftMd^ttMB9U 
iS»«Ofe*W3£ * ftfc^Tj (DIE L $ Ht 8 T* 

[0 0 9 0] £ibtc, »*#ai:LT^f , -i:*jiMBlc 
ifti UT, £j*SftfcAM<DJ»*«£SHJ:<&fcir0> 
[0 0 9 1 ] 

* £ 1 1 t£4b#:<D 2 fc5EBfc±T«> 2 &jc£ 

<t , extern ftfc* j^wMjatKo^x 
immmi-^mm^m^mt, tftfc 

Wft© aft ttitt* t S§gtB&£ric * K <fc o Tt# h 

[0 0 9 2] :L0ftffirom*g2£ffi«ft#:&«t£S 

ft, *ftofW0EJtBft*^1-*E*Hre£&¥il! 

ffi«*ttffl¥U:£, *±®ifi«tf 

<o-+*f*-* * t i (c^ftco 2 ftjcBflLh-C-w 2 &tgS 
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2fcK&m'<*-yk&mi%m&<Dffiwt:m^xv9$ic> 
immm k, &mmx'&btnz 

[0093] ^o»ww8**JS3i^5iittiteaKji 
fit, »Ites)cfgAi7yn^r?xf+/^-y 

^® t x«$ Ltz<Dx\ mmn^m^ Lxyy?j» 

«j*>*j#, fcSVMtSBfcft^SWl-s 9^*Wo x 
5^£#X*#53y&#fc5 0 

[0 0 9 4] rro«93roSft*£4£{gS4M^«8&ft 

It, ^Bfc£$^«#?:^Afc7^*^+/<*-J/ 

fc&Artl-s^-oB&Art^Sfcio^roB&Art 

fc>itfcfc<DX;ibt), c\<D£ SfcLfcifcfcJ:!?, BIK*t 
*Wf:#Lt7>n Ky 

[0 0 9 5] -<O^KC0H^5{C^5H^a^@ 
ft, SE8tli^^#S*s, ftft&ofev 

rite ft, «j«s«i*lroijbafflfaFt>»< fsrt^-ets^j 

[0 0 9 6] r<D|§K<Off*«6^5^^i!c^S 

it, e«Bift4j*^a««, ffiFft^oili^sgRtiii**^ 




mmm'fo't&L^wt; t . i&M&&&mm& t &&&&& 

[0 0 9 7] ^(O|60J(7)tt*Jl7|C#5iS^a^g 
tftoS-^tt^^lII-SffitftS-Stt^E^air, ISSfcwffi 

z <Dm%a Ltzmmb mmmm±^mc x^xm t>ntz 
®*<D®#<D&mftnb&mGi-z>tftnm'k¥&bi:ffi 

[oo9 8] z<r>%w<Diti#*%8iz.g(kZ>®tmmmw. 

KSS®»*^ft±a^tti-S^»:eDft 

mmmto&*m<om*frb®ftim<om& j £*fc®.b l 
xmm&±fc^ztoto-mm^m.QLi&^WLb, m 

*b, 2&7z&m'<f-ybm®mm&^*timm 

tftw^stt^#ui-5isifts-att^sE#a<b, m&<D& 

r coBSi Lfc Wft t EKKft±jft^gK «fc o T # b*ifc 

[0099] z<D&w<Dn#m9K&z>w&m ! mmm 

LfcHfc <!r , gS¥r - * t Jttfc L TIE U >gS?i|ri> if 5 tf> 
-5«5flsgB?iJ^3£?ai , BK LfcHfctfSipT* 




#$¥1 0-31742 



So 

loioo] ^<n%w<Dm*m i o ic&s <m&mnm 

LfcH^t , ±IBS«t-^ fcttft LX1E L^BMfrZ 

-t- 5 g^ig^a * *r 1- s pm^e t ^m^a t * 
tfmmbtezm%-'<?->&£ix^t£^®&\mwQi 

%% J $>±&i'X7 L J*(D l gm%\ciEL<m-£iXX^^j:^Z. 
[0E<75fiPi&ift9n 

[0 l ] r.©»WroHlfia)jg'|| l wfltf&Sr^-fT'p y 

*0-?fcSo 

[02] ni&aMiRi<onte<»mti&7frr-7v-*-* 
~hx*hz> 0 

[El 3] HJgc0^fl|llCioltS«-a|iglC*3^T4fi)c$ 

n/iii^-cfcSo 

[04] ^ro^co^W^ffi2cDHI^^^-r^n y 

tmxhz. 

[0 5] HJSro^|g2(0|(jfproggn«r^i-7n-^^ 

- HTfcS. 

[06] Ky h^^-VCDfigWttt^0-Cfc 

So 

[0 7] l/tl«©^n J/ y fy^»JilW@ 

-CfcSo 

[08] ;:©»Hro2**<0»K3<&*riifc*-j-:7ny 
^0-C*>So 

[0 9] H^co^fl83coi!)^ro«n$r^1-7n-f-Y 

- hT*fcSo 

[010] ®fl?tfe«BgfiHfl|*^a^«cSi5Srttffl 

x U'^j^Srtf 54*tawtft^0-CfcSo 
[0ii] z<n%W<r>nM<DMM4<»mi$.Zmi--7a 
•ytmxhZo 

[012] ms.nWMAnm^m^m-fyxj-'f- 

\~ hx-foSo ........ 

[013] «»«*WSIftS:fflV^T»{*:ffiHlt*ttai-6 
»f^*»«)«-aH!fS: «r*+H*> So 

[014] Z<»XW<Dni&<r>Bte5<Dmi&**1r-7a 
y^0T'foSo 

[015] mm(OKm5<nmft<Dffii\Z7iki-ya-3- 
+ - hT'foSo 

[016] tife3feg>iiifttegg«g)tear^)B»^ittw 

0T'foSo 

[017] 0 1 6jc^±MSSiifewz£iz±±ri±^ 
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1120] '&*<Dm<nm&<&m<D?.T u^^mmm 

[El 2 1 1 ^<DW\<Dmikmm(Dm 2 0<D7 a ~^->r 

l i l 2 g§f«Iiifg;£j£3M^ l 3 

a, l 5 e^/Sa^i^^, l 6 ^fr-ffer-* 
17 2ft^g*^-y£$3M§:, is m 

ttfiB&m^a, 1 9 tiraa^a, 20 7 

(A)tt«tt*k 



^^^f-r^-^ajt^a, 21 iB^A^#a, 2 

2 ^fi/tll7'p-^^ttm 3 0 

»3t«, 3 1 mmi£7ny?ftfctf^& y 32 a 

n^ttw^a, 3 3 mte&m^u v v 

3 4 EftH**/&¥JK, 6 4 ^«s^tt*a^-frffiSi4 

■dt#», 6 5 (gifts stt^ti^a, 6 9 mmm®. 

ffl#«, 7 1 WE?IJ£i¥x-?-<-^ 7 2 

eww*#«, 73 i^a^a. 

[^«*tiE2] 
I*B3E*f«sqiB<&] El 1 6 

[Ell 6] 




Ml 



wfBttl 





G Z 
9 




[f^HaE3] 
[ijE^tl^] EJffi 
[*tjE#fcJSS£] Hi 7 
[ttUE^te] XX 

[Hi 7] 



START 

m 



1 



1 



I 



I 



1 



END 



-sroi 



ST02 



-5T03 



' ST04 



-ST06 



*ST07 



[«HE*fSiJSB£] Hi 8 
101 8J 




i^tmiE 5 ] 

IMIjE*r*MI4] HIE 

IfflE^JSi*] 01 9 

IffltlE^ffi] g?Jg 

10 1 9] 

Gray Coded Paturns 




b'o o ! Ill ? ? 8 8 /""wHiwted \ 
C-0 I I lol 0 I I ?K>-niuml«ilnJ 



mjEmnt*m%] mm 
m$.MMi.mB&] 020 

[0 2 0] 



•d+l»» 



*dM- 




«S«diip 



KM 



l¥*tt&IE7] 

[ffljEM^s«*] mm 
imiEttMims*) 02 1 

[ffijEr*J«] 
[02 1] 

fifltA* 



I^ttiE 8 ] 
[«nE*t**B*] 02 2 



-ffil5- 



